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The paper considers the issues, decisions, and 
practices involved in evaluating the Technical Assistance Development 
System (TADS) , a project to provide assistance to demonstration 
projects and start education agency grantees in the Handicapped 
Children ' s*Early, Education Program. Section 1 considers the focus for 
the evaluation in terms of its purposes (including providing ongoing 
feedback regarding the delivery and quality o| individual technical 
assistance services), audiences and their information needs, the 
nature of the program being evaluated, and implication of the focus 
for the evaluation design. It is pointed out that the purposes of the 
evaluation made it necessary that the design include inquiry into 
four areas — the TADS contract, individual technical assistance 
services, all other services provided by TADS, and topics about which 
the staff wish to know more. The evaluation design is explained in 
aother section. Considered are the evaluation questions and criteria, 
the inquiry approach, data collection procedures, data analysis 
procedures, and reporting. Finally, the organization, constraints, 
and supports of the evaluation are discussed. Appended materials 
include forms summarizing technical assistance services, needs 
assessment and evaluation instruments, and a TADS end of year survey 
form. (SW) 
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This Occasional Paper (number 4) was prepared for our colleagues and others 
interested in the diverse ideas and practices of technical assistance. This 
material ^reflects* some of what TADS has learned through its ten years of 
providing support services to model demonstration projects and state 
education 'agency grantees of the Handicapped Children's Early Education 
Program (HCEEP). this program is administered by the Office of Special 
Education, OSERS, U.S. Department of Education. 

TADS provides technical assistance to designated projects and states when 
it is requested and needed. TADS is a division of the Frank Porter Graham 
Child Development Center, University of North Carolina at Chapel Hill. It 
is located at 500 HCNB Plaza, Chapel Hill, NC 27514. Our phone number is 
(919) 962-2001. 
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Who* information should be gathwed to evaluate technical 
cu>6ibtance? 

Who should provide the information? 

Hovo can a techvuxual oAhiAtance agency which provide* a 
helping ivivice aJUo evaluate the effecZivenu* of that \ 
Advice? 

What ruouJicu (Vie needed to conduct an evaluation of 
technical a&6it>tance? 

These questions are examples of the types of issues confronted in ^ 
designing and implementing evaluations of technical assistance (TA). 
Unfortunately, when such issues surface, there is little in the literature on 
evaluation concepts and experiences to guide technical assistance agency 
staffs. 

One way to begin answering these questions is for TA providers to share # 
information on the evaluation of their services. t This may include defining 
issues, solutions, and practices. When identified and analyzed, strengths 
and weaknesses, or successes and problems, can be used to crystallize concepts 
and develop models that may be used by the whole TA field. 

It is the purpose of this paper to contribute to this process of sharing 
by presenting the issues, decisions, and practices which have been parts of 
one technical assistance agency's experience the Technical Assistance 
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Development System (TADS). The evaluation described 1n the fol lowl ng pages 
has been developed and used over the past five years as TADS provided 
assistance to demonstration projects and state education agency* grantees 1n 
the Handicapped Children's Early Education Program (HCEEP). 

Technical assistance agencies vary from each other 1n t6rms of client, 
groups, purposes, and methods of providing services. Nonetheless, they are 
all likely to encounter program evaluation Issues that are similar. To help 
the readJh compare his or her experience with our's, the evaluation of TADS 
1s described according to a general model for evaluation (see Figure 1). 

<■ 

- " ■ J 

FIGURE 1 

Elements of a Program Evaluation Design 
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Procedures 
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Procedures 
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, FOCUS 

An oversight or omission in much evaluation work is a clear specification 
of focus.. To avoid the problems that an inadequate focus creates for an 
evaluation (e.g., the choice of inappropriate instruments, poor timing o'f ^ 
evaluative events, etc.) and to achieve a consensus on an evaluation approach 
among staff members, considerable time and effort were spent in clarifying 
the focus for the evaluation of TADS. The results of the discussions to 
determine the focus, which sometimes were heated but always enlightening, 
are described be^w. 

Purposes of the Evaluation 

The evaluation of TADS was designed to be both formative (to improve the 
technical assistance system) and summatlve (to demonstrate its overall 
effectiveness or worth).' ' Specific purposes'/of the evaluation were: 

». 

1. To determine 'If objectives for Implementing the TA system as 
stated 1n its contract had been achieved; 

2. To provide ongoing feedback regarding the delivery and quality 
of 1nd1v1d0al TA services; 

3. To determine the overall effectiveness of the TA as designed 
and delivered by TADS; and 

4. To generate new knowledge regarding the nature and processes 
of technical assistance. 

Audiences and Their Information Needs 

The purposes for the evaluation of TADS, to a large extent, grew out of 
the evaluation Information needs of Its audiences. The audiences for the 
evaluation were: 

1. TADS staff 

2. Office of Special Education (OSE) staff (OSE, TADS federal contracting 
agency, is part of the U.S. Education Department.) 




3. Frank Porter Graham Child Development Center (FPG) staff (FPG is 
located at the University of North Carolina and 1s the adml n 1 s tra ti ve 
agency for TADS.) 

* 

4. TADS professional colleagues- 1 e.g. . other technical assistance 
agencies, special educators, medical personnel, and state education 
department personnel.) 

To improve the TA system, TADS staff members needed continuous feedback 
regarding Individual TA services and periodic^ feedback on the overall status 
and effectiveness of all services provided. To manage the TADS contract 
effectively, Information was needed on the accomplishment of administrative 
objectives. Finally, staff members were Interested 1n learning more about 
the process being used, so successes could be, shared with other professionals 
and problematic processes could be changed, modified, or terminated. 

OSE staff members needed Information about the status of TADS activities, 
and the accomplishments and quality of the technical assistance provided to 
clients.. Because OSE funds several technical assistance programs, the agency 
also was Interested 1n receiving any results which provided new Insights 
about TA. 

It was assumed that the leadership of FPG would be Interested in the 
successful completion of the TADS contract and the effectiveness of the TA 
system. The IADS staff also believed that colleagues at FPG and other TA 
practitioners would be Interested 1n new knowledge, Insights, or -practices 
discovered or developed as a result of TADS experience 1n providing technical 

■ * 

assistance. 

Nature of the Program Being Evaluated 

TADS . The elements of a technical assistance system most directly 
affecting its evaluation are: (a) its goals; (b) the approach used to 
achieve the goals; and (c) the types of services provided (Suarez, 1980). 
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The overriding goal of TADS is to assist 1n and enhance the overall 
development of the HCEEP programs for which Its clients (the leadership and 
staffs of HCEEP funded programs) are responsible. To 'accomplish this goal , 
TAbS offers assistance in the early-ch1ldhood-spec,1al -education content areas 
1n which the clients are working and 1n the overall organization, administra- 
tion, and, operation of client programs. 

The attitude or philosophy toward technical assistance taken by TADS is 
that 1t should be supportive, responsive, interpersonal, and nonevaluati ve. 
TADS provides assistance to clients within the framework of a particular, 
systematic, yearly process focused on specific early-chi ldhood-special- 
education content areas. The process itself consists of five distinct, 
cyclical stages: (1) program planning; (2) formal, total -program needs 
assessment; (3) development of an agreement between the client and TADS for 
work that is needed to accomplish Identified TA needs; (4) delivery of the 
technical assistance; and (5) evaluation of the services." (See Figure 2..) 




• FIGURE 2 

The TADS Process of Technical Assistance 
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TADS provides a comprehensive; and varied form of (a) ih-field, 
(b) 1n-house, and (c) 1n-pr1nt services (L1ll1e and Black, 1975)' to meet the 
overall goal of program development and the specific client needs Identified 
during the needs assessment. These services are designed to create awareness, 
aid 1n program planning, enhance skills, or a1d'1n the actual development or 
Implementation Of the program. The technical assistance services commonly 
offered by TADS are: on-site and off-site consultations, information searches, 
visits to exemplary programs, reviews and critiques of plans.-and products, . 
small and large group workshops, a quarterly newsletter, and publications on 
topics X)f concern to clients. 

TADS Clients and Their TA Needs . The primary client groups served by 
TADS are well defined. The funding source restricts direct TA services to: 
(a) three-year demonstration projects ; and (b) state education agenc y grantees 
which are planning statewide comprehensive services, for preschool handicapped 
children and their families. 

The demonstration projects have similar overall purposes, and their staff 
members work 1n some of the same general areas. The states, on the other 
hand, share the general goal of developing and/or improving services to 
preschool handicapped children and their families, but they vary considerably 
from the projects 1n the efforts they undertake to accomplish this goal. 

Through experience, TADS has Identified the major categories 1n which 
most client needs fall. Demonstration projects most' often need help 1n the 
content areas of: services for children, services for parents, staff 
development, demonstration/dissemination, admlnl strati on/management, and 
program evaluation. Needs of state education agencies vary more from grantee 
to grantee, but they Include areas such as: 'Statewide planning, developing 
Interagency agreements,, In-service training, teacher certification, and 



program evaluation. In terjns of pro gram development , both demonstration^ 
projects and states need assistance In decision-making, planning, obtaining 
Information developing skills and competencies, developing specific materials 
or procedures, and revising and refining existing materials or procedures. 

y 

Implication of the Focus for the Evaluation Design 

Clarification of the focus of the evaluation provided TADS with two 
things that were very Important. First, the clarification process itself 
provided a vehicle for involving staff members 1n the evaluation and 
encouraging their commitment to 1t. Second, clarifying the focus provided 
information which could be used to tailor the evaluation to TADS specific 
needs. By examining Figure 3, the reader can begin to see how the design 
needed to be shaped (on the basis of focus) to encompass and address TADS 
needs . 

The purposes for the evaluation made 1t necessary that the design Include 
Inquiry Into four, somewhat distinct, areas: the TADS contract, Individual 
TA services, all other services provided by TADS, and topics (regarding the 
provision of technical assistance) about which the staff w1she> : tp know more. 

The audiences for the evaluation and their Information needs affeoteo\ 
the type and timing of evaluation reports. The TADS staff neede^ ongoing,, 
periodic, and summary (yearly) Information, The funding agency required 
1nformat1pn relative to the contracts. Reporting mechanisms for providing 
this Information (Quarterly Progress Letters) were specified 1h TADS contract 
with OSE.^OSE. and FPG needed the same summary information provided to the 
TADS staff. All audiences needed reports of special studies on technical 
assistance as they were developed. 

The goals and philosophy of TADS suggested further considerations foi" 
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FIGURE 3 
Focus of the TADS Evaluation 



FOCUS 



PURPOSES OF THE EVALUATION 

1. Determine 1f contracted objectives were met 

2. Provide ongoing feedback to the TADS staff regarding 

the technical assistance provided 

3. Determine the overall effectiveness of TADS 

4. Generate new knowledge regarding technical assistance 



AUDIENCES 

1. TADS staff: 

2. Funding agency (OSE): 



THEIR INFORMATION NEEDS 

Status of contract, delivery and quality of Individual 
technical assistance services, overall effectiveness 
of TADS technical assistance, new knowledge regarding 
the delivery of technical assistance 

Status of contract, effectiveness of TADS as a provider 
of technical assistance 



3. Administrative agency (FPG): Overall effectiveness of TADS technical assistance, 

new knowledge regarding technical assistance 



4. Other technical assistance 
professionals: 



New knowledge regarding technical assistance 



NATURE OF THE PROGRAM BEING EVALUATED 



1 . TADS 



a. Goal: fnhance development of client programs 

b. Approach: 

(1) Attitude— Responsive, supportive, nonevaluatlve 

(2) Structure— Systematic, Individualized, client-staff oriented 

(3) Types of services— In-fiouse, In-field, In-print 

2. Clients {HCEEP funded demonstration projects and State Implementation Grants) 

a. Gbals Create, develop, and/or Implement model 

services for preschool handicapped children 
and their families 

b. Technical assistance needs: Specific content areas In the flelb of 

early childhood special education, program 
development processes and Procedures 



the evaluation. First, the overall goal of TADS and the focus of Its 
services required that the evaluation concentrate on variables related to the 
organizational and programmatic development of the client programs. TABS 
philosophy required that the evaluation be nonevaluatlve of the client and 
that 1t not Interfere with' the supportive. Interpersonal aspects V the 
technical assistance. • 

The structure of TADS TA process.'(Figure s 2) permitted the evaluation^ 
be systematic (across clients and client groups), but the individualized 
nature bf the TA required that the evaluation design accommodate differences 
in the amount, type, and content of 'services that were delivered to individual 
clients. The variety o1j types of services provided to clients made 1t 
necessary to tailor data collectidn procedures to each specific service. 

With regard to the clients , the evaluation needed to reflect the 
differences 1n the two primary client groups.. It also had to focus on the 
connon needs of the groups and the indlvlduaf needs of the programs 1n each 
of them. 

DESIGN 

' • j 

Even when the focus for an evaluation 1s specified, designing Its 
specific content and, procedures 1s not unlike putting together a puzzle 
containing an Incomplete set of oddly shaped pieces. The focus provides the 
framework for the "puzzle. iy It shows how most of the pieces fit together. 
But there are some areas of the puzzle for which tftere are no pieces. \ These 
pieces can be located, only after you have other parts of the puzzle put 
together and can see what 1s needed (I.e., after decisions regarding details 
are made and as other Issues relative to evaluating, technical assistance 
are confronted and resolved). The following discussion provides an explicatl 
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o*f the TADS evaluation design including the "missing pieces" and the' ideas 
and strategies thst were combined to provide the complete picture of the 
process. 

Evaluation Questions and Criteria 

On the basis of the decisions made about the focus of the evaluation, 
five major evaluation questions were developed. They corresponded almost 
ectly to the purposes for the evaluation. 

■ ■ ' \ 

0 

1; Has TADS fulfilled the provisions of its 
contract with the Office, of Special 
Education? If not, why not? 

2. How effective has TABS been in providing ; 
services to its clients? • 

'.) ■ 

3. How satisfactory have been the services ..« 
provided to clients by TADS? 



4. What has been the impact of TADS technical 
assistance on its clients? 

5. What has been learned about technical 
assistance? 



> 




' When specific planning began, additional . questions ^e re asked to sharpen the 
responses that could be given to the five major questions. These and jother g 
details of the evaluation design are- outlined in Figure 4.' 

Criteria to determine if evaluation results were satisfactory were based 
on several considerations. First, the staff of TADS wished to complete all 
of the work in its contract with OSE. Therefore, all questions, related to 
contract work had "successful completion of aVl_ work promised" as the 
criteY-ta for a satisfactory answer. Provisions were made, however, for 
modifications in the contract which occur naturally as detailed- planning is 
completed and the priorities of the contractee or funding agency change. 

Second, data gathered prior to developing this evaluation system 
contained very high ratings of TADS services by both client groups. It was 
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FIGURE 4 
TADS Evaluation Design 



Evaluation Questions 



Has »TADS fulfilled the 
provisions of its con- 
tract with, the Office 
of Special Education? 
If not; why not? 

A. H$ve the short- 
term^ objectives of 
the TADS contract 
been met? If not, 
why not? 



, Criteria 



A. All work completed 
as specified and/ 
or modified 



Inquiry Approach 



A. 



Objective- based 
evaluation 



Data Collection 
Procedures 
(Provider of Information) 



A. 



Gathering of docu- 
mentation of work 
completed (TADS 
staff) 



Data Analysis 
Procedures 



A. Comparison of 
work completed 
with objectives 
stated In the 
contract 



Reporting (To the 
TADS Staff, OSE, 
Leadership of FPG 
or Other Profes- 
sionals) 



A. 



arterly 
6tjress 
fetters 



11: How effective has 
TADS been in pro- 
viding services to 
Its clients? 

A. What have been the 
characteristics of 
the services deliv- 
ered, i.e. , number 
of services., type 
of TA, content area, 
TA provider, number 
of days, number of 
people involved? 

B% Has TADS provided 
the services to 
clients specified 
in the Technical 
Assistance Agree- 
ments? 



Has TADS provided 
' other specified 
services to clients: 
e.g., conferences, 
needs assessments, 
newsletters, etc.? 



A. Not' applicable 



g0% of technical 
, assistance agrees 
ment-scheduled 
services deliv- 
ered 



All services 
delivered as 
specified (and/or 
modified) in the 
contract 



A. Description 



B. Discrepancy 
evaluation 



C. Discrepancy 
evaluation 



A. Recording of data- 
regarding services 
del 1 veined-- on 
Aggregate Summary 
Form (TA Coordinators) 



Recording of data- 
regarding services 
delivered— on Aggre- 
gate Summary Form 
(TA Coordinators) 



C. Recording of data— 
' regarding services 
delivered— on Aggre- 
gate Summary Form 
(TA Coordinators) 



Compilation of 
data contained 
1n Aggregate 
Summary Form 



B. Computation of 
percentage of 
services dellver- 
ed»as scheduled; 
comparison of 
percentage with 
criteria 

C. Computation of 
4 percentage of 

services deliver- 
ed as scheduled 

Comparison of 
percentage with 
criteria 



Quarterly 

progress 

Letters and 

End-of-Year 

Evaluation" 

Report 



End-of-Year 

Evaluation 

Report 



Quarterly 

Progress 

Letters and 

End-of-Year 

Evaluation " 

Report 



FIGURE 4 (1974-75) 
Instructions For The Needs Assessment 
(Second.year projects' on site needs assessment) 

The enclosed materials have been prepared to assist 1n the assessment of 
technical assistance needs for HCEEP projects, who are a PP™ 1 ™* el * ^" way 
1n their three-year. funding cycle. The expected outcomes of this needs 
assessment are as follows: 

1. To visit the project site; meet the staff and observe 
the program (1f desired by the project director). 

2. To review the t*ctln1cal assistance services provided 
to the project over the last six months- and report 
results. 

3. To review the project's renewal proposal anoVplans i 
i for the third year. 

4. Jo Identify the project's technical assistance needs 

(using the TOP). 5 

5. To develop a tentative Technical Assistance Agreement. 

6 To identify any strong components 1n the project that 
might be a resource for TAOS 1n the future. 

The contents of' this needs assessment kit should Include: 

1. An information sheet on the project. 

, 2. A description of the technical assistance the project 

has received during the last six months. 

,l " 

3./ Two copies, of the TOP. 

• 4. A copy of Guidelines for Writing Technical Assistance- 
Agreements . * > - 

■ 5 r Blank Technical Assistance Agreement forms. 

6. Forms for writing th,e report on the needs assessment. 

7. Travel reimbursement forms." 



1975-76 



Two major changes in the needs assessment process occurred in 1975-76. 
First, TADS abandoned its request that all new projects prepare a 
Program Plan Outline as a needs assessment Prerequisite. Getting 
a completed program outline from the project and sending it to the 
needs assessor prior to his or her visit took a disproportionate 
amount of time; and, in many instances, the outlines were never 
received or were incomplete. 

In place of the plan, projects were given five workguides to 
complete, one each to cover Administration and Management, <, 
Staff Development, Programs for Children, Programmer Parents, 
and Demonstration and Dissemination Components. Each workguide 
contained tasks which an HCEEP project should complete as ts 
program evolved. After completing each workguide, the project 
filled in a checklist on the front page giving a quick sugary 
of the status of project development in that ■ COT P™i; t : ho jS5st V 
Figure 5 for example of Admini station and Management Checklist.) 
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FIGURE 4 
(coptinued) 



Evaluation Questions 



Criteria 



Inquiry Approach, 



Data Collection 
Procedures 
(Provider of Information) 



Data Analysis, 
Procedures 



Reporting (To the 
TADS, Staff, OSE, 
Leadership of FPG 
or Other Profes- 
sionals) 



D. What additional 
services not 
specified in the 
contract or tech- 
^ nical assistance 
agreements has 
TADS provided? 



D. Not applicable 



D. . Description 



Recording of data— 
regarding additional 
services provided— 
on Aggregate Summary 
Form (TA Coordinators) 



Compilation of 
data contained 
in Aggregate 
Summary Form 



D. 



Quarterly 

Progress 

letters and 

End-of-Year 

Evaluation 

Report 



111. How satisfactory 
have been the serv- 
ices provided to 
clients by TADS? 

A. Were the direct 
services— i.e., 
workshops, on- 
site and off -site* 
consul tations, 
small group TA 
meetings, review 
and critiques, 
visitations, in- 
formation serv- 
ices—perceived by 
clients to be of 
high quality? x 

B. Were the indirect 
services— i,e., 
newsletter, pub- 
lications, etc.-- 
perceived to be 
useful to clients? 

C. Were the clients 

.» satisfied with the 
services delivered 
by TADS? 



Mean ratings of 
"good" or higher 
in each service 
delivery area 



B. Mean ratings of 
"good" or higher 
in each area 



C. Mean ratings of 
"good" or higher 
in each area 



A. Survey research; 
discrepancy eval- 
uation 



Survey research; 
discrepancy eval- 
uation 



C. Survey research; 
discrepancy eval- 
uation 



C. 



Completion of appro- 
priate TA Event 
Evalu ation Form 
(client and,; If 
appropriate, TA 
provider) 



Completion of 
Publication 
Survey (cTTents) 



Completion of appro- 
priate TA Event Eval- 
uation Form an d End- 
of-Year Survey 
(clients) 



Computation of 
means of ratings; 
comparison of 
mean with 
criteria 



8. Computation of . 
means of ratings; 
comparison of 
mean wi th 
criteria 



Computation of 
means of ratings; 
comparison of 
mean with 
criteria 



C. 



Forms returned 
to TA coordi- 
nators; £nd- 
of- Year Eval- 
uation Report 



End-of-Year 
EvaTuatTon" 
Report ~ 



Forms returned 
to TA coordi- 
nators; End- 
of-Year Eval- 
uation Report 



twenty people to its organization and technical assistance 
process and trained them in the needs assessment process: 
including the TOP, Program Planning Workguides, and agreement 
writing. ■'. * - 



1976-77 

The process developed the previous year was used again in 
1976-77. The TOP was expanded to assess "Staff" as well as 
the three original areas (see Figure 6). All first-year 
projects continued to receive on-site needs assessments. 
Variations in needs assessment procedures were tried with 
second-year projects:. (1) conducting needs assessments by 
telephone and (2) offering an Evaluation Track option. 

' " ■ ' , v > 

TADS decided to try telephone needs assessments for two 
reasons: the lajrge number of clients and the success of the 
-,i systematic approach to a needs assessment which the Program 
Planning Workguides (see Figure 5) and the TOP (see Figure. 6) 
had facilitated. Six second-year projects that were meeting 
' their goals and objectives and maintaining a positive rapport 
'•' with TADS were identified. When contacted, each agreed to^ 
have a telephone needs assessment in place- of an on-site visit. 

The assessment materials were mailed to each project. A 
time for the phone call was scheduled by the TADS staff needs 
assessor with the project '<s contact person to occur, typically, 
after TADS received the completed Program Planning Workguides, 
continuation proposal, and progress report for review. The 
telephone needs assessment included a discussion of the 
reviewed material and a joint rating of the TOP. Since this , 
was a lengthy procedure in itself, usually another phone call 
was scheduled to complete the needs assessment — confirming 
needs, timelines, and kinds of assistance. 

' The Evaluation Track, which a project could choose instead of 
a comprehensi/ve needs assessment, provided a yearlong series 
of consultations in evaluation planning. Nine second-year 
projects opted for jbhis alternative in lieu of on-site 
heed! assessments^ These projects felt their "need" priority was 
evaluation. There was no further assessment of needs for those 
who chose this option. A Technical Assistance Agreement was written 
with each project outlining a comprehensive, on-site delivery 
method with an evaluation consultant. 

Third-year projects were "weaned" from TADS by having the option 
of attending a topical conference in Demonstration/Dissemination 
, Activities at TADS expense. .There were no needs assessments with 
third-year projects. 

1977-78 

During the spring of 1977, TADS supported an external evaluation 
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Mount 4 
(continued) 



Evaluation Questions 


f 

' Criteria 


Inquiry Approach 


Data Collection 
Procedures 
(Provider of Information) ■> 


Data Analysis 
Procedures 


Reporting (To the 
TADS Staff, DSE, 
Leadership of FP6 
or Other Profes- 
sionals) 


IV. What has been the 
impact of TADS 
technical assistance 
on its clients? 

A. Has progress been 
made in areas tar- 
geted for technical 
assistance? 

B. What were the 
organizational 
and programmatic 
impacts of TA? 

C Were the impacts 
6f the technical 
assistance on 
clients positive? 


A. Significant differ- 
ence (p $ *tS5) 
between status of 
needs before and 
after technical 
assistance 

B. Not applicable 

C. 9£% of impacts 
indicated to be 
positive 


A. Survey research;, 
discrepancy eval- 
uation 

B. Survey research; 
description 

C. Survey research; 
discrepancy eval- 
uation 


A.\ Completion of 
XCfl^f-Year Survev 


A. Computation of 
correlated t-test 

B. Computation of 
(1) percentage of 
clients Indicating 
an Impact; (2) 
means of Impact 
for each Item 

C. Computation of per- 
centage of respon- 
ses that were posi- 
tive; comparison 

of percentage with 
cr1£eMa mm 


A. End-of-Year 
Evajuat16n 


(clients) 

o 

B. Completion of 
End-of-Year Survey 
(clients^ 

C. Completion of 

■ End-of-Year Survey 
(clients) 


Report 

B. ^ End-of-Year 

Evaluation 
Report 

C. End-of-Year 
Evaluation 
Report 


W What has been learned 
about technical 
assistance? 

A. May less costly strat- 
egies be used to con- 
duct an effective TADS 
needs assessment?' 
(1979-8D) 

B. What occurs as tech- 
nical assistance is 
provided? (1979-82) 

€. How does technical 
assistance change 
during the life of a 
three-year project? 
(1978-81) 


i 

. a! Not applicable 
B. Not applicable 

0 

,C. Not applicable 


A. Input evaluation; 
exploratory 
research 

B. Case study; 
exploratory 
research 

C. Survey research; 
exploratory 
research 


A. Completion of Needs 
Assessment Evalua- 
tion Forms (clients 
and needs assessors) 

i /% 

B. Dbservatljon, inter- „, 
views y(external '■ r 
consultants) 

cT*"Wfcent analysis of 
technical assistance 
provided; completion 
of TA Event Evalua- 
tion Forms & End- 
of-Year Surveys 
(clients) 


A. Comparative statis- 
tical analyses, 
e.g., analysis of 
variance, ch1- 
square 

,. B. Coritent analysis 
of cases 

C. Comparative 
statistical 
analyses 


A. Special Re- 
port; journal 
article 

B. Special Re- 
port; journal 
article 

C. Special Re* 
port; journal 
article 



two third-year — field tested the new materials,. Minor modifications, 
were made based upon the field-test experiences and the materials 
were prepared for use with- projects. ' 

On November 8-9, 1977, TADS held a training meeting for thirty " 
needs assessors. Fifteen trainees were totally new to TADS needs 
assessment process. (See Figure 7 for agenda topics.) The ' 
purposes of the new Profile and how to use it with the projects 
were the primary foci of the meeting. 

In mid-winter of that year, the U.S. Office of Education determined 
that the needs assessment forms should* undergo ,, clearance M before 
their use could be required of projects. TADS immediately notified 
its needs assessors and clients, instructing them no't to require that 
the forms be filled out in preparation for the assessment but to use 
them only for informal planning. 

Since the forms-clearance process would take several months, TADS 
designed alternative heeds assessment and technical -assistance 
delivery processes for second- and thjrd-year projects. Small - 
group meetings on topic's with which projects tended to need help 
were offered to all clients. They could select, via mail or 
telephone, two such meetings to, attend at TADS expense. 

These small groups each involved four to seven prbjects working 
with consultants to address areas Of need., Group presentations 
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assumed that this phenomenon was the result of the high quality of TADS 
technical assistance or the natural tendency of people to rate TA types of 
' activities quite favorably, or a combination of the two. These assumptions 

led to the selection of above average results as the criteria for acceptable 
responses by clients and TA providers regarding the quality of services ♦ 
delivered. 

Finally, some of the questions required descriptive rather than 
evaluative answers.- These questions were designed* to obtain information that 
would provide the ttasis for interpreting other results or, in the case of the 
research studies, ne^ information regarding TA. It was inappropriate to 
assign criteria to these questions but important that the questions themselves 
be included. 

Inquiry Approach 

Because of the variety of information needs, no one Inquiry approach 
* could be used to provide the data that the evaluation questions required. 
Each question had to b§^onsidered for its own 1nfor*mat1on needs, and ail f 
appropriate inquiry approach to those needs had to be chosen. 

The first decision to be made was whether the approach required 
evaluation or another form of inquiry. Some questions clearly demanded an 
evaluative response. Others, as mentioned previously, required descriptive 
answers. Still others, particularly those related to discovering new 
knowledge, called for research . 

Once the basic approach was determined — description, evaluation, or 
research — it was necessary tf/ be more explicit about the type of Inquiry so 
that data collection and analysis procedures could be chosen. For those 
questions that were evaluative, several types of inquiry were indicated by v 
the questions and their criteria. Objective-based evaluation (Gallagher, 

ERIC is ^ u 



Surles and Hayes, 1972; Popham, 1972) was used tq determine the accomplishment 
of objectives. When meeting criteria rather than accomplishing objectives 
was the basis for determining results, discrepancy evaluation (Provus, 1971) 
- comparison of results to a previously established standard - was used. 
For one of the special studies, an input evaluation approach (Stufflebeam, 
et al., 1971) was selected as most appropriate. 

Specifying the generic type of evaluation or research needed did not, 
for some questions, provide sufficient guidance for the design of data 
collection procedures. For them, primarily those requiring information about 
or*from the clients, additional specification was needed. In order to obtain 
continuous feedback from clients regarding TA services and at the same 
time build a data base'to use for summarizing data about the total client 
group, a quick* turn-around system of Inquiry was needed. Survey research 
was chosen as the approach because of the speed with whi<^ formation could 
be acquired, the systematic data 1t could provide, and its feasibility in 

terms of time and cost, 

For the research studies, approaches appropriate for the specific v 
research questions posed were used. Because there was no body of knowledge 
on which to base the study of TADS type of technical assistance, all of these 
approaches were considered exploratory . 

Data Collection Procedures 

Analysis of the information needed in order to complete the inquiries 
led to the development of five types of data collection procedures. 

~ The TADS Filing System was established to provide a storage and retrieval 
system for the documents which related to the objectives in the contract. It 
consists of extensive files maintained by the Director of TADS and staff 
members who have specific responsibilities relative to the contract. 

£ " ■« 



The TARS Aggregate Summary Form was developed to provide a system for 
recording and describing all services provided to clients. (See Appendix A.) 

Maintained by the technical assistance coordinators (the staff members at 

■-J , 

TADS who maintain liaison with -clients and arrange TA services) responsible 
for technical assistance to clients, Jthes^ forms provide information on: 
clients 1 needs, the type of assistance provided, the amount of assistance, 
the number of clients participating in the assistance, and the type of TA > 
orovi,der (e.g., a TADS staff meijjber or an external consultant). 

The TA Event Evaluation Forms are questionnaires designed to provide 
both systematic Information about all services and unique information on 
specific types of technical assistance events,, "TA events" include needs 
assessments and the specific services designed tb meet individual technical 
assistance needs identified during those assessments! Forms have been * 
developed for: consultations, reviews and critiques, visits to other 
progratfiT, information searches, needs assessments, small group meetings, and 
workshop presentations. (See Appendix B for examples of each TA event form.) 

These farms are sent to clients when the specific TA fs provided. In 
the cases of the needs assessments and consultations, the consultant who 
provided the TA also receives a form. Responses on the form provide 
descriptive information about the event itself, about client and consultant 
perceptions .of what the TA accomplished, and about the client's level of 
satisfaction with the technical assistance and its quality. 

The TADS End-of-Year Survey is sent to cl ients at. the completion of 
each cyiple of TA (i.e., each year). It provides information regarding: 
(1) progress toward meeting technical assistance needs, (2) the impact of the 
TA on programmatic and organizational areas of the client programs, and 
(3) perceptions of overall satisfaction with the TA provided by TADS during 



the year. (See Appendix C.) ' 

Specific forms were not developed for, the case study. Instead, four ^ 
questions were specified to guide the observations and interviews of the 
external consultants (Behr, Hawes, Vandiviere, and Suarez, 1981). 

i \ i 

i i 

Data Analysis Procedures 

Most of the evaluation questions required that specific types of results 
be compared to preestabllshe(( standards or that the data provide a description 
of the TA as it occurred during aWlven year. Consequently, data analyses 
were needed which summarized resultsSof TA with the total client group. The 
computation of summary statistics, e.g., frequencies, percentages, means, 
etc., 1s, therefore, the first step and base for most data/analysis procedures 
used in the evaluation. These summary statistics are then compared to the 

preestabllshed criteria. 

For other questions, particularly those for additional research studies, 
the selection of appropriate data analysis techniques was necessarily 
specific to the questions posed. (Refer to Figure 4.) 

Reporting 

To meet the needs and Interests. of the evaluation audiences, five types 
of written reports are prepared. The TADS staff members responsible for 
technical assistance (primarily the technical assistance coordinators) 
receive the written feedback of clients and consultants on the TA Event Form 
as 1t 1s received 1n the TADS offices. From the ratings and comments on the 
forms, they determine if the TA was perceived to be successful and, then, 
design appropriate followup activities. 

Quarterly Progress Letters are prepared to provide a descr1pt1or^oJ^ 
activities undertaken and progress made toward meeting the objectives stated 



in the TADS contract. . .Documentation to support or further describe activitiek 
is attached. These Letters are sent to the TADS staff ,%ie funding agency . 
(OSE), and the administrative agency (FPG). They serve, for all three 
audiences, v the purpose of providing information which can be used to manage 
the contract. 

An End-of-Year Evaluation Repdrt is prepared each year to provide 
information on TADS effectiveness in delivering technical assistance, the 
quality of the services delivered, and their impact on the clients and their 
programs. This report provides 'the TADS staff, OSE, and FPG with summary 

' ' ' . ' 

informatiori regarding the organization's effectiveness. The information can 
be used to modify and Improve future services. 

Two types of reports furnish Information to TADS audiences and the field 
at large on new knowledge about TA. They are special reports and Journal 
articles . Special reports, i.e., reports of studies conducted to learn more 
about TA, are distributed to. the TADS staff, OSE, FPG, and professionals in 
other technical assistance centers around the country. From these reports and 
other data gathered, journal articles are written to share the new information 
with a wider audience. 

CONDUCTING THE EVALUATION 

, \ 

As the reader is aware, knowing what you would like to do and getting 
it done can be two different things. Organization, Resources, and fiscal 
support have a great Influence on the success of an evaluation. This 1s 
particularly true for new programs, such as technical assistance, for which 
there has been neither a history of or Impetus for extensive evaluations. 
TADS has been fortunate 1n the way Its organizational structure has evolved 
to support the evaluation process. 



Organization -> / 

X/fecause the primary audience for the evaluation Is TADS staff members 
who^'need ongoing feedback to accomplish" their tasks, It was determined that 
a,t- least part of the evaluation should be conducted internally. From TADS 
earliest days, a positipn within the organization entitled "Associate 
Director of Evaluation" has existed. The importance given evaluation by the 
designation of a full-time administrative position- with accompanying staff 
support and the organizational level at which the position was placed are 
noteworthy. 

: Organizationally,' the evaluation section of TADS 1s one of four distinct 
operating units, the others being TA Services to Demonstration. Projects, TA 
Services to States, and Publications. The Associate Director responsible for 
the evaluation 1s part of the management team, under the guidance of TADS 
IfTreetor, that comprises a fifth organizational component — Administration^ 

One of the keys to the operation 1 and success of the TADS evaluation 1s 
the data management system* A half-time data analyst and manager has the 
responsibility of coding; entering, cleaning, and analyzing all of the 
quantitative data gathered. The analyst works most of the time at the FPG 
data management center where all of the equipment, services, and expertise 
needed to store, retrieve, and analyze data are located. The 'analyst 
deliberately spends some time at the TADS offices. This arrangement allows, 
the analyst to become familiar with the organization and to provide data 
services to members of the TADS staff other than those -directly Involved in 
the TADS evaluation. 

At"var1ous times 1n Its history, TADS has hired outside consultants and 
consulting agencies to revlev^and aid 1n the design and Implementation of 
its evaluation. Other .efforts to obtain completely external evaluations of 




the system have been proposed to the contracting agency, but not funded. 

1 » * 

Resources for the Evaluation 

As the current evaluation system has been implemented,, the resources 

for the evaluation have increased. Currently, the resources for the 

evaluation of TADS include: 

1. Financial Support : Funding within the Contract provides for 
staff salaries, consultant and contractual s6r;v1ceis, supplies, 
and computer services. 

,,2. Personnel : An equivalent of two full-time program positions 
are assigned to conduct trte evaluation. They Include the 
associate director, half of the time of a program evaluation 
specialist, and a half-time data analyst and manager. Other 
TADS staff members and, when needed, external consultants 
provide input into and/or review of evaluation activities or | 
products. Clerical support is provided by the TADS secretarial f 
st^ff and temporary secretarial service agencies. 

3. Facilities : Office space, equipment, and facilities are 
provided through the contract by the University of North 
Carolina. TADS has access to the computer facilities of 
the Triangle Universities Computation Center through the 
data management office of FP6. • . . 

r 

Constraints and Supports - 

In addition to resources, there are< other constraints and supports 

which affect the evaluation of TADS. 

Constraints- . In spite of the detailed planning and resources available, 

there are constraints which place limits on the amount or type of evaluation 

that can be done. 

First, most of the evaluative information gathered is client perceptions 
of the technical assistance. For consultations and needs assessments, 
perceptions of consultants are also obtained. Both perceptions of the 
process are valuable and should be a part of any evaluation of technical 
assistance. Due to cost and feasibility considerations, other perceptions, 
are not routinely obtained — e.<£, those of all client staff members, y ~ 
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persons in the administration of the agency in which the client program 
operates, persons in the funding agency, TADS staff members, or external, 
objective observers. This limits not only the amount of information available 
but also the spectrum, of views which would provide a complete portrait of 
the technical assistance. It was for this reason that the case study was 
implemented. . v While all the perceptions listed above have not 'been obtained, 
many have been provided via the case descriptions of technical assistance to 
two demonstration projects. (See Bqhr, Hawes, Vandiviere, and v Suarez, 1931 .) 

Related to this constraint is the known bias in the perceptionsof most 
clients; TADS services are provided at no cost to the clients and in ay 
supportive and responsive manner. Clients do not tend to respond negatively 
to free services arranged by nice people* The bias is recognized and steps 
are taken in the evaluation to minimize its effects: e.g., the positive 'end 
of rating* scales has been expanded to permit greater discriminations. The 
presence of the bias, however, continues to affect the evaluation Results 
that are obtained. . A'. 

Finally, TADS commitment to being 1 a nonevaluative source of assistance 
precludes direct evaluations of client program operations or progress. As a 
result, the scope of the evaluation is narrowed to ?lient perceptions of 
progress made in only those areas in which technical assistance is provided. 
WhiVe- definitely useful, it is recognized that assessment of the effects of 
the technical assistance/is not as comprehensive as, in an ideal situation, 
it might be. ^ 

Supports . The strong support for the. .TADS evaluation by air who are 
involved ha % been extremely beneficial if not crucial. Administrative 
support and involvement at TADS, by underscoring the importance of evaluation, 
has made it easier to get the job done. Financial support from the funding 



agency has permitted the expansion of evaluation efforts and the subsequent 
implementation of the. evaluation described in this paper. 

It is probably not .possible to overemphasize the importance and value 
of a supportive staff to internal evaluation efforts. The interest and 
involvement of the TADS staff in the evaluation has led to the efficient, 
and comprehensive implementation of the evaluation design and noticeable 
improvements in data collection procedures and reports. In addition, the 
staff has provided the impetus for special studies by suggesting topics, 
aiding in their implementation, and requesting information from the evaluation 

unit. 1 , 

Much of the data that is gathered for the evaluation comes from TADS , 
clients and consultants. Due in large part to the rapport established by the 
TADS staff with the clients and the support of clients themselves, return 
rates for questionnaires are uniformly high and extensive reedback is provided. 

> • . — 

SUMMARY 

Technical assistance is, by its nature, a complex, process. Evaluations - 
of the process are therefore necessarily complex and varied because of the 
types of technical assistance provided. It has been the intent of TADS staff 
membe'rs to develop an evaluation system which addresses the complexities and 
the specific nature of the technical assistance they provide. The system 
described in this paper has been a useful one. It is hoped that by describing 
the system, the ideas presented can be used by other technical assistance 
agencies in designing their specific evaluations and by the field at large 
in improving the overall quality of technical assistance evaluations. 



/ , 
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AGGREGATE SUMMARY OF TA SERVICES 



Project Name: 
City, State: 
ID Number: 1 



TA Coordinator: 





TOTAL WJ 


IHBER OF TA N 


EEQS IDENTIFIED 1 


JY CONTENT AR 


EA 




Children 


Parents 


Staff Dev. 


Demo./Dlssem. 


Evaluation 


Admin, ft Hang. 


total 








t 









im Type of Service Code 

1. On-Slte Consultation 

2. Visitation 

3. Information Service 

4. Review and Critique 

5. Additional Technical Assistance 

6. Topical Conference 

7. Newsletter 
B. Publication 

9. Small Group Consultation 

10. Off-site Consultation 

11. Needs Assessment 

12. Orientation Conference 

13. Conference/Workshop Presentation 
M. Other 



^mmtent Area Code 

I., Services for Children 

2. Parent Involvement 

3. Staff Development 

4. Demonstration and Dissemination 

5. Evaluation 

6. Administration and Management 

7. All Areas 



TA Provider Code 

1 . TADS Staff 

2. TADS Consultant 

3. NASDSE 

4. TADS/NASDS1; 

5. NASOSE/Consultant 

6. TAOS/Consultant 

7. TADS/NASDSE/Consul tant 

8. TADS/ WEST AR 

9. TADS/WEST AR/BEH 

10. TADS/NASDSE/BEH 

11. TADS/BEH 

12. Other 



First Quarter (Oct. 1 - Dec. 7) 



Second Quarter (Dec. 8 - Mar. 7) 



fete 


SAA 

No. 


Type 
of 

Service 


Content 
Are* 


No. of 
Clients 


Olrect 

Service 

Hours 


"TA 
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Total Services for the Quarter 



Total Services for the Quarter 



Third Quarter (Mar. 8 - June 7) 



Fourth Quarter (June 8 - Sept. 30) 



Date 


TAA 

No. 
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No. of Service TA 

Clients Hours Provider 
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Total Services fur the Quarter 



Total Services for the Quarter , 



FIGURE ,15 
Sample Profile Summary 



IjJCEEP DEMONSTRATION PROJECT PROFILfJ 

^^^■ ^ SuMHAftY PAGE_ 

Olrectlons: 0) Afttr completing tht entire HCECP Ogpnitnttlon Project Prof lit ; A Heed s Assessment Inst rumenV CIRCU the m**en of etch Uii In each pro-, 
gram component that you Indicated a desire for change In status during fne current funding year. 
(2) Place a "I" through any circled task number that you Indicated a need for "outside" or technical assistance. 



(3) E-ample; © 2 3 $ *jJDj8} 8 

Mmin 1st ration and Management Component 

Program Planning ............ 

Personnel ... 

Physical Arrangements 

financial Administration ...... 

Evaluation Planning 

Records and Reports 

Advisory Boards ... 

Coordination with Other Agencies . . . 



PROGRAM DEVELOPMENT PHASES 



II Services to Children Component 



lit. Services to Parents Component * 



IV. Staff Development Component 



V. Demonstration, Dissemination and Continuation Component 



Conceptual liatlon 



12 3 * 5 6 7 8 
9 10 II 
1? 13 II 
IS 16 U 

18 19 20 21 22 23 21 25 26 

27 28 

29 30 31 

32 33 

Ot. 



1234 5 6 7 8 9I0U 12 
13 14 15 16 17 18 

Ot. 



1 2 3 4 5 6 7 8 9 10 

Ot. 



1 2 3 4 5 6 7 
Ot. 



1 2 3 4 5 6 7 8 9 10 II 12 
13 14 ot. 



Implementation 



34 35 36 37 38 39 
40 41 
42 43 44 
45 46 

47 48 49 50 51 

52 53 
5'. 55 
56 57 58 

Ot. , 



19 20 21 22 23 24 25 26 27 
28 29 30 31 32 

Ot . 



11 12 13 14 15 16 17 18 19 

Ot. 



1 

8 9 10 11 12 
Ot. 



15 16 17 18 19 20 21 22 23 
24 Ot. . 



Evaluation 



59 60 61 62 '63 64 

Ot. ... ... 



33 34 35 36 37 38 39 
<0 

Ot. _ , 



20 21 22 23 24 25 

Ot . i 



13 14 15 16 17 18 

Ot. i 



25 26 27 28 29 

Ot. ; 1 



The Work Sheets , Each technical assistance need is recorded on a 
Work Sheet (Figure 16). The focus of the technical assistance, the people 
who will be direct recipients of the assistance, and the date by which the 
assistance is to bp completed are all included on this form. Then this 
information is used to write a Technical Assistance Objective. Finally, 
a delivery method that addresses the need efficiently and effectively 
1s chosen. 

Seguence-of- Technical-Assistance Activities (Figure 17). For each 
delivery method listed on the Work Sheet,, a Sequence form has been developed. 
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AGGREGATE SUMMARY OF TA SERVICES 



Project Nat*: 
CUy, State: , 
10 Number: _ 



TA Coordinator: 



TOTAL NUMBER 


OF TA NEEDS 1 


DENT! F I ED BY CONTENT 


AREA 


f1 ' 1 




Program Development/Management 


Evaluation 


Personnel Training 


Interagency 


Comm./Olssem. 

i 


Total 



(0 



T ype of Service Cade 

1. On-Slte Consultation 

2. Visitation 

3. Infonntlon Service 

4. Review and Critique 

5. Additional Technical Assistance 

6. Topical Conference 

7. Newsletter 
B. Publ Icatlon 

9. Small Group Consultation 

10. Off-site ConsulUtlon 

11. Needs Assessment 

12. Orientation Conference 

13. Conference/Workshop Presentation 

14. Other 



Content Area Code 

1 . Program Oevel opment/Manageieent 

2. Evaluation 

3. Personnel Training 

4. Interagency . « 

5. Coamwnlcatlon/D1ssea1nat1on 

6. All Areas 



First Quarter (Oct. 1 - Dec. 7) 
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Third Quarter (Mar. 8 - June 7) 



TA Provider Code 



1. TAOS Staff 

2. TAOS Consultant 

3. NASOSE 

4. TAOS/NASOSE 

5. NASOSE/Consul tant 

6. TAOS/Consul tant 
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8. TAOS /WE STAR 

9. TADS/MESTAR/8EH 
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11. TA0S/8EH 

12. Other 
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Area 


No. of 
Clients 


Direct 

Service 

Hours 


TA 

Provider. 
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Second Quarter (Dec. 8 - Mar. 7) 



Typt 

TAA of Conttnt 
Datt No. Service Area 


No. of 
Clients 


Olrtct 
Service 
Hours m 


tA 

Provider. 
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Fourth Quarter (June 8 - Sept. 30) 


Typt 

TAA of Content 
Datt No. Servlct Area 


NO. Of 
Clients 


Olrtct 

Service 

Hours 


TA 

Provider 











































































































































ToUl Services for the Quarter 



Total Services for the (fciartar , 
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FIGURE 17 

Sequence of Technical Assistance Activities 

Sampl e 



SEQUENCE OF TECHNICAL ASSISTANCE ACTIVITIES 
FOR 



| ON-SITE CONSULTATIONS 



NEED 
PRIORITY 
NUMBER 



VII: 



STEPS 



Sequenct of Activity Theprimary purpose for thii form if to indicate the dotes of the activities that both the pro ect staff and TADS 
need to accomplish in order to address the technical assistance objective and need that are associated with this activity sequence, If more 
than one objective .s listed for an Individual need there should be separate activities indicated for each objective. See Section III of he 
' manual for a more detailed discussion of how to M« this form. ('The first step should occur at (east two to three weeks after completion 

of the needs assessment.) 

*» 

ACTIVITY DESCRIPTION 



(3 weeks prior to Step 4) 



_ (date),* the project will complete and send to TADS a Consultation Preparation 

Form. 1 



2 B Otcesnber ' ~ (date), ....... TADS will identify and confirm with the project t£e consul tan t(s), TADS 

# 16 wefiki orior to S«d 4) support the consultant's services for up to days and visits 

(6 weeks prior to Mep 4) ^ ^ (Specify the number of consultant days and visits,) 

3 By nsr&sntf QLl {jL I (date), TADS and the project will confirm the dates of the consultant's visit. 

(4 weeks prior to Step 4) j 

4 py sJ&s **'~'* lJ ffit 



(date) the consultant will visit the project for days \o {YQ l /dC $B& M 

m requested by the protect) //^f on fa /J*Jtr,S yW ^£ 7^2^L 

(Please specify number of days of consultant's first visit and the specific 
tasks to be addressed, use the back of this form if more space is needed.) 



. (dato), the consuiunt will send to the project and a copy to TADS a summary 

report on the visit Including recommendations for follow-up activities. 

m (dan), the designated suff will send TADS a completed Evaluation of Consulta- 
tion report form, 

NOTE' Since these steps represent the minimal preparation and follow-up activities, yog are encouraged to build In other activities that will help 
both you and TADS to address the need and objective. Please use the below space and the reverse of this page. Be sure to date the acti- 
vity and fit it into the sequence above by re-numbering the steps. 



(2 weeks after Step 4) 

6< ?v January . /<? 
(2 weeks after Step 4) > 



Step. 



By 



RECOMMENDATIONS, QUALIFICATIONS, AND OJMER INFORMATION: Please list below any specific qualifications the consuiunt 
should have and/or requested consultants for this activity. 
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City, State 
Project ID 



Dates of Needs Assessment 
Needs Assessor 



Type of Needs Assessment On-sl te 



TECHNICAL* ASSISTANCE DEVELOPMENT SYSTEM 
PROJECT EVALUATION OF NEEOS ASSESSMENT 



This d*e*(lonn«i re Is designed to gather Information regarding the TAOS ' needs assessment conducted with your 
project. The Items are designed to provide TAOS with information regarding the needs assessment procedure end 
yoflr' opinions regarding its quality end usefulness. The Information provided by fit projects will be used to 
determine the effectiveness of our ntuds assessments. YOUR RESPONSES TO ITEMS Will REMAJN STRICTLY CONFIDENTIAL 
and will be reported only fn combination with rnfornUftlon gathered from other projects. We would appreciate 
your most honest and objective opinions. THANK YOU, 



I. THE NEEOS ASSESSMENT: 



3. 



5. 



6. 



Listed bejow is a set of statements of criteria for a TAOS 1 needs assessment. 
Please rate the extent to which' you /believe the needs assessment of your project 
met the stated criteria by clrcllno/the appropriate number. For question 6, 
please follow the Instructions glveh-wlth the item? -i J 

Not M*t 1 Exceeded 

Hat Partially Completely Stated 

' , Criterion 



I. The needs assessment provided 
a comprehensive review of 
the project. / 



The needs of the project* those 
requiring and not requiring 
technical assistance, were 
identified. 

I 

A Hit of clearly specified 
needs" to be addressed by tech- 
nical assistance was developed. 



Technical assNttgLnce activities 
for the needs described In Item3 
above were Identified. 

Roles and responsibilities for 
the project staff and TAOS In 
planning and carrying out tech- 
nical assistance were clarified. 

In addition, to these criteria, 
were there other accomplishments 
of the needs assessment process? 
(please check) 

If yes, please describe: 



I 



Yes 



,5 



No 



TAOS, UNC-Chapel H1 1 1 , 1 98 1 




APPENDIX B 



THE NEEDS ASSESSMENT MANUAL: Plust rat* the quality of the neads assessment manual by circling the 

appropriate number for each of the following Items. Place any comments 
you may have regarding the manual In the faction labeled "comments." 



2. 



Clarity . I.e., extent to 
which contents are clear, 
understandable, etc. 

Completeness , i.e.. extent 
to which information needed 
to complete the needs 
assessment Is Included, etc. 

Format . i.e., extent to 
which organization, format 
of the manual makes It easy 
to use, etc. 



Usefulness, I.e., extent to 
which the content! of the 
manual are of use in plan- 
ning and participating In 
the needs assessment. 

5. quality, I.e., overall 
quel I ty Including freedom 
from errors, misleading 
Information, writing style, 
etc. 



Unsatis- 
factory 



Not at 

AH 



Below 
Average 



Averege 

3 



Some- 
what 



Good 



Excel- 
lent 



Excep- 
tional 



© • 



AatJper 
Completely Precisely 



6. To whet extent were the 
procedures outlined In the 
manual followed during your 
needs assessment? 



7. Comments: 




SEE NEXT PAGE 



3i 3b 1 
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III. THE HEEDS ASSESSOR: 



Plnsi rata the following character I it lei of the needs e'ssessor by circling your 
response on each of the following Items. Place any comments regarding the needs 
assessor In the section labeled "Comments." 



r 



Unsatis- 
factory 



1. Preparedness. i.e., familiarity 
with the project k s proposal and 
other rejevant materials sent 
to him/her, familiarity with 
the Needs Assessment process 
and materials, etc. ■ 

2. Expertise. I.e., knowledge of HCEEP 
project operation, ability to assist 
in the identification of needs, etc. 

3. Organ I gat I on/Management Skills. I.e., 
leadership ability, attention to 
task, summarization skills, priority 
setting ski lis, etc. 

4. Flexibility. I.e., ability to edjust 
schedules, focus, etc. to meet 
project needs; etc. 

5., Interpersonal Skills . I.e., ability 
to relate well to the staff, sup- 
port I veness, open, non-threatening 
approach, etc. 



Below 
Average 



Average 



Good 



Excel- 
lent 



Excep- 
t lone I 



6. Comments} 



IV. THE OVERALL NEEDS ASSESSMENT PROCESS: 



Please rate the total needs assessment process by circling your 
response to each of the following Items. Please answer the questions 
end provide comments, where appropriate, In the "General Comments 11 
sectloq. Please note In your comments any particular strengths or 
weaknesses of the process. 



Unset Is- Below f 

factory Average Average 



Good 



Excel- 
lent 



Excep- 
tional 



A. Satisfaction with Needs Assessment 



1. Extent to which the needs assess- 
ment experience met your iteff's 
expectations. 

2. The usefulness/applicability Of the 
needs assessment to your project. 

3* The quality of the overall needs 
assessment process. 

J). Your overall satisfaction with the 
tote I needs assessment experience* 



General Comments : 



e 
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THANK YOU. 
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Oates of Needs Assessment 
Needs Assessor 



TECHNICAL ASSISTANCE DEVELOPMENT SYSTEM 
SIG EVALUATION OF NEEDS ASSESSMENT 



^ISv^lnTw. «pr«Md. PI..,. Pl.c. th.s. .nd oth.r cogent, you wou.d Ilk. to m.k. In Section I M .t th. 
•nd of the form. 

I. THE NEEOS ASSESSMENT: PlM.. rate th. extent to which the following Item* were .ccomplJ.h.d during the needs 

assessment. 

Not Accomplished 
Accompl Ished Adequately 



Accompl tthed 
v Very Well 



Accompl tthed 
Exceptionally 
Well 



I. The needs essessment provided a compre- 
hensive review of your SIG plan. 



2. 



3. 



5. 



II. 



The needs of your SIG, those requiring 
and those not requiring technical 
ess (stance, were Identified. 

A list of clearlyspeclfled needs to be 
eddressed by technical assistance was 
developed. 

Technical assistance activities for the 
needs described Jn Item 3 above were 
Identified. 

Roles and responsibilities for your SIG 
and TAOS In planning and carrying out 
technical assistance were clarified. 



THE NEEOS ASSESSOR: Please circle your response io the quality of the needs assessor on each of the follow- 

t I 



2. 



3. 



Ing Items. 



PreperednesS , I.e., familiarity with 
the SiG propose I end other relevant 
material.* sent to him/her, familiarity 
with the' needs essessment process and 

m^terle&s.,. etc. 

Expertise , 1 .e. / knowledge of SIG grant 
operation, knowledge of early childhood/ 
special education, ability to assist In 
the Identification of needs, etc. 

Organ I let I on /Management Skills , I.e., 
JaJoarshlp ability, attention to task, 



Unsatls- BeJow 
factory Average Average 

, , r 



Good 
k 



Excel- 
lent 



Excep- 
tional^* 



^ ^luWariratlon ski lis, priority setting 
^skills, etc. 

k. Flexibility . I.e., ability to adjust 
schedules, focus, etc. to meet SIG 
needs, etc. 

5. Interpersonal Skills . I.e., ability to 
relate well to the staff, support I veness, 
open, oon-threatanlng approach, etc.j 



TAOS, UNC-Chapal Hilt, 1981 
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ML OVERALL OPINIONS: Please consider the total needs assessment In responding to these questions. 
I. Whet was your overall satisfaction with the needs assessment? (Please circle) 1 



Not at all . 1 

Satisfied 'Satisfied 



Extremely 
Setisfied 



Exceptional ly 
Satis* ted 



2. What were the most useful espects of this needs assessment for your SIG7 (Pleese list) / 



|. What would you recosssend 
(Ptease list) 




Ing In or adding to the needs assessment to Improve the process7 



H. Other Comments: 



-V- 



THANK YOU. 



3 



is 
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Project ID, 




Project Location 

Oates of Needs AjHiiwnt 
Heads Assessor 



TECHNICAL ASSISTANCE DEVELOPMENT SYSTEH 
NEEDS ASSESSOR EVALUATION OF ON-SITE 
NEEOS ASSESSMENTS 



honest end objective opinions. THANK YOU, 



sment 



I, TIME EXPENOEO: Please provide the Information requested In eaclrtlank. 
I. How much time did you spend on the nndi essessmant? 

, Hours 

tn preparation 

on-site conducting the needs 

_^ _ In follow-up 

Listed below Is a set of itittMoti of criteria for e TAOS 1 needs at sessmert t. 
P case ratine extent to which you btlltvt tht needs assessment ypu conduced met 
thTlt.Sa crit.H. by circling the appropriate number. For question 6. plt.it 
follow the Imtructloni given with tht Item. 



M . THE NEEDS ASSESSMENT! 



Not 
Mtt 



Hat 
Partially 



Mtt 
Completely 



Exceeded 
Stated 

Criterion 



1. The needt estestment provided e 
comprehensive review of the 
project. 

2. The ntedi of the project, those 
requiring and not requiring 
technical aiilitance, ware 
Identified. 

3 # A Hit of clearly specified 
needi to be addreiAd by tech- 
nlcal e'sslstence wes developed. 

*. Technical aiilitance actlvttlei 
for the needi described In Item 3 
above were Identified. 

S. tolei and reiponitbt 1 1 ties for 
the project staff and TAOS In 
planning and carrying out tech- 
nical assistance were clarified. 



TAOS, UNC -Chapel HIM, t$8t 
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6. In addition to these criteria, 

were there other accomplishments of 

the needs assessment process? (Please check.) 



Yes 



No 



l f yes , p 1 ease descr I be : 



THE NEEOS ASSESSMENT MANUAU Please rate the quality of the needs assessment manual by circling the 

appropriate number for each of the following Items. Place any comments 
you may have regarding the manual In the section labeled "comments." 



Unsatis- 
factory 



I. Clarity , I.e.. extent to i 
which contents are. clear, 
understandable, etc. 

2* Completeness , I.e., extent 
to which Information needed 
to complete the needs assess* 
ment Is Included, etc. 

3. Format , I .e. , extent to 
which organization, format 
of the manual makes it easy 
to use, etc. 

k. Usefulness . I.e., extent to 
which the contents of the .. . 
manual are of use in plan* 
nlng and conducting the 
needs assessment. 

,5. Quail ty , I.e., overall 
qua! I ty Including freedom 
from errors and misleading ■ 
Information, writing, style, etc. 



Not at 
All 



To what extent were the 
procedures outlined triTthe- 
/ manual . fbl lowed during this 
needs assessment? 



Below 
Average 



Average 
3 



Some- 
what 



Good 
k 



Excel- 
lent 



* Rather 
Completely 



Except 
tlonal 



Precisely 
6 



J. Comments : 





- 1 












, — 



SEE NEXT PAGE 
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IV. THE PROJECT: Please rate the following characteristics of the project by circling the response 

which reflects your opinion of the extent to wKich the characteristic, was evident. 

- - Not Somewhat Quite * Per- 

Evident Evident Evident vasive 



1. Understanding of the needs 
assessment process . I.e., 
famf 1 Jar 1 ty wl th TAOS and 

the purpose- of, the needs '„ 
assessment, familiarity 
with needs assessment 
materials, the activities 
comprising the process, etc. 

2. Preparedness , i.e., all needed 
, staff in attendance , ca I enda rs 

cleared, necessary materials 
at hand, all appropriate staff 
oriented to needs assessment 
procedures, etc*- 

* 

3. Openness, I.e., willingness to 
share Information, wl 1 1 ing- 
ness to consider new, ideas, 

etc' i ,. T 

Leadership Support , i.e., 
* prov i s I on of u a<equate re- 
sources, facilities, etc. , 
support of the needs assess- 
ment, involvement in the 
needs assessment, etc. " 



5* * Comments* 



I 



6. 



• * r ■* 



* g % $ *5 *.. - " if * £ 



V. General Comments? Please list here any comments that you wish to make regarding the needs assessment. 

* Please note in your comments any particular strengths or weaknesses of the process. 









— i — p ' 


; i4 u i , 












• ^ '* t 






— : — : — 1 \ 






K 













* A- 



THANK YOU. 
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PROJeCT/SlG 



TECHNICAL ASSISTANCE DEVELOPMENT SYSTEM 
Demonstration Project/SIG* Evaluation of Consultation 



Project/SIG 



ID ■ • 

Dn-Slte 

Dff-Slte ~ 

Process m Final 

Content Area 



PURPOSE: We would appreciate information from you and your staff concerning the recent TADS-sponsored 
consultation which is described below. This form includes a series of questions and ratings which are' 
flVsloned to monitor and evaluate our work. Your feedback will be combined with Information from other 
^rejects an<i SJGs |0 ^determine our current, effectiveness and improve tutyre consul tations . It also will 
be s ha red with t he^coftiu ft aa t wW wt» r ked ~w rt h^y OU . " You f cbmmen fcs wl 1 1 otherwise rema I n confident ial . 

We would appreciate your honest and objective opinions. THANK YOU VERY MUCH FDR YOUR TIME AND THDUGHTFULNESS . 



Technical Assistance Need No. 



Technical Assistance Objective No. 



Consultant: 



Dates: 



ERLC 



Instruct ions : Please rate, check or list your responses regarding the consultation on the following items. 
We would also welcome additional comments regarding aspects of the consultation or TADS? procedures In 
arranging the consul tat I on which were Important to your and your project/SIG. 

t. QUALITY DF THE CONSULTATION 



A 



The Consultant 
.(Please circle your response) 

1. Preparedness , i.e., familiarity with the 
project/SIG proposal and other relevant 
materials sent to him/her, familiarity 
with your technical assistance need, etc, 

2. Expert Ise , I .e. , knowledge of. his/her 
content area, knowledge of other 
resources In the area* etc. 

3. Organization/Management Skills , I.e., 
leadership ability, attention to the 
task specified above, summarization 
skills, priority setting skills, etc. 

k. Flexibility , i.e., ability to adjust 
schedules, focus, etc. to meet project/ 
SIG needs, etc. 

• * * 
5. Interpersonal Skills , i.e., ability to 
relate well to the staff or colleagues, 
• support Iveness, open, non- threatening 
approach, etc. '* 

*State Impiementat ion Grant 
TADS, UNCrChapel Hill, 1 980 



(A O 
C to 



tl 1) 




1 


Q."fl3 


* qHjEss'-^— — -2 


8 


**5 *■* 
u c 

X «1 


n 






LU — 




2 3 


k 


~ ^ $ 


6 










2 3 


4 


5 




2 3 


k 


5 


6 


2 3 


k 


5 


6 


2 3 


u 


5 


6 
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A, The Consultant (Cont'd) : t 

6. Would you recommend the consultant who worked with 
you to other proJects/SIGs with a need similar to 
yours? (Please check) No_ 



If No or Yes, with reservations , please explain: 



Yes, with reservations Yes 



B. Satisfaction with Consultation : 
(Please circle your response) 

1. Extent to which the consultation met 
your stiff's expectations. 

2. The usefulness/applicant I Ity of the 
r consultation to your staff and 

proJect/SIG. 

3. The quality of the overall consultation. 

k. Your overall satisfaction with the 
consultation. 



<-» O 

n <-» 
c m 



'5 • 

si 



« 



8 

a 



a. <■ 

o c 

»5 



6 
6 



I I. OESCRIPTIOM OF THE CONSULTATION ACCOMPLISHMENTS. 

A. What were the major accompHshnmnts of *he consultation? (Please list) 



B* Does your project/SIG still have a need for technical 
assistance In this area? (Please check) 



No 



Yes 



If Yes, please describe: 



SEE NEXT PAGE >> 
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III, COMMENTS . 



A. Were there soma particularly strong and/or useful 
aspects of this consul tet ton? (Please check) 



Yes 



If Yas , picas* describe: 



6. Msra there some weak or nonuseful aspects of 
this consul tet ton? (Pteese check) 



Yes 



No 



If Yas, pltase dascrtba: 



■ 1 , 



C. General Comments: Pleese list here eny additional comments that you wish to make regarding the 
consultation. • » 



Person completing form: 



(Name) 



rStaT? Position) 



Return to TAOS 

500 NCNB<f Uza 

Chapel H$l, N. C. 2751 <♦ 



THANK YOU. 



A, 
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CONSULTANT 




TECHNICAL ASSISTANCE DEVELOPMENT SYSTEM 
Consultant Evaluation of Consultation 



Project/Slfi*_ 



ID 

On-SI te 
Off-Site" 
Process __ 
Content Area 



Final 



PURPOSE: We would appreciate Information from you concerning the recent TAOS-sponsored consultation 
which Is described below. This form Includes .a series of questions and ratings which are designed to 
monitor and evaluate our work. Your feedback will be combined with Information from other consultants 
to determine our' current effectiveness and Improve future consultations. 

We would appreciate your honest and objective opinions. THANK YOU VERY' MUCH FOR YOUR TIME ANO 

THOUGHT FULNESS 



Technical Assistance Need No. 



Technical Assistance Objective No. 



Consultant: 



Dates: 



In structtons: Please complete the following regarding your work with the project/SlG. If your answers 
are contained In your report to the project/SlG, please reference the report In the appropriate space , 
and attach the portions of the report containing your response. , 



|. THE CONSULTATION. 

A. How much time did you spend on th 
consultation? (Please list) 



No. of 
Hours » 



In preparation 

on-site or with prdject/SIG represent tve(s) 
conducting the consultation 

In fol low-up 

(n travel (NOT applicable to off -site consultations) 



ft. How many project/SlG related persons 
were Involved In the consultation? 
(Please list) 



No. of 
Persons 



SOt of the time or more 
. Less than 50* of the tin 



1 I T of 



ERLC 



*State Implementation Grant 
TAOS, UNC-Chapel H1 11, t9«0 
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C. Briefly describe the consultation, I.e.* major consent areas covered, major.. .act ivltle*, etc. Also 
Include any major activities which were unrelated, to the need and objective .H s ted on the first page. 



Please rata the following characteristics, of the projcct/SIG by circling the response 
which reflects your opinion of the extent to which the characteristic was evident. 



II. THE PftOJECT/SIG. 



Never 

Evident 



Sometimes 
Evident 



Usually 
Evident 



1 . Understanding of the purpose 
of the consultation, I.e., 
familiarity with TAOS and the 
purpose of the consultation, 
knowledge of the activities 
to be conducted during the 
consultation, etc. 

2. Pr eparedness , I.e., all needed 
ff In attendance, calendars 1 



sta 



3. 



cleared, necessary materials 
at hand, all appropriate staff 
oriented to purpose of consul* 
tatlon, etc. 



I, 



wl lllngness to 
on, wl II Ingn 
to consider new Ideas, etc. 



Openness , . - a 

snare information, willingness 



7 * 

k. Leadership Support , I.e., provl- I 2 3 

sion of adequate re sour ce s , 
facilities, etc,, support of the 
consultation, involvement In the 
consultation/ etc. 

M»' ACCOMPLI SHMENTS OF THE CONSULTATION. 

A. What were the major accomplishments of the cctnsu ftatlon? (Please list) 



Always 
Evident 



3. 



il 1 



SEE NEXT PAGE 
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8. Does the proJect/SIG still have technical assistance need's In this area? N Q MI ! ,, Yes _ 
(Please check) 



If tn, pitas* describe: 



COMMENTS. Please provide your opinions regarding the consultation by answering the following questions. 

t 

A. Were tliere, in your opinion, some particularly strong 

Mnd/or useful aspects of this consultation? (Please check) _ 



Yes 1 ' No 



If Yes> please describe: 



a. Were there some weak or nonuseful aspects of this _ 

consultation? (Please check) "° 



If Yes, please describe: 



C ; . Genera 1 ! Comments:, Please list here any additional comments that you wish to make regarding the 

,C • con su 1 1 a 1 1 on . ' 



Return to: TAOS 

500 NCNO Maza 

Chapel Hill, NC 275»*» 



THANK YOU. 
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V 



' TECHNICAL ASSISTANCE DEVELOPMENT SYSTEM 
Demonstration Project/SIG* Evaluation of Informat Ion Sarvlce 



Projact/SIG 



10 ^ 

Process FlnaF 
Content Area 



PURPOSE: We would appreciate Information from you and your staff concerning the recent TAOS -sponsored 
Information service which Is described below. This form Includes a series of questions and ratings which 
are. designed to monitor and evaluate our work. Your feedfeeck will be combined with Information from 
other project s/SIGs to determine^ our current effectiveness enjd improve future technical assistance, it 
also will ba shared with' the' person who provided the service. Your commants will otherwise remain 
conf identlel . v 

Ue would appreciate your honest and objective opinions. THANK YOU VERY MUCH FOR YOUR TIME ♦NO 

THOUGHTFULNESS. 



Technical Assistance Need Mn, 



Technical Assistance Objective No. * ] 



Consultant • ■ Oates: 



instruction! : Please rate, check, or list your response to the quality of the technical assistance on 
each of the following Items. We would also welcome additional commants regarding aspects of the Infor- 
mation service or TAOS 1 procedures for arranging the Information service which were Important ( to you 
and your project/SIG. 



I. QUALITY OF THE INFORMATION SERVICE. 
(Pleese circle your response) 1 



2 t 




% s 

tft u 






si 




i 



I 1 l! 



( 



8 



A. Extent to which the information \ 2 3 * 5^6 

prmp^rmd and sent by TAOS met 
your staff's axpactat Ions . 

ft. The usefulness/applicability of I 2 3 k 5 6 

the information to your project/SIG. 

C. The quality of the overell I 2 3 * 5 6 

information service. 

0. Your overell satisfaction 1 2 3 * 5 6 

with the information service. 



OVER 

TAPS, UHC-Chepel Hill, 19*0 J 



*Stata Implemantetion Grant 



APPENDIX B 



I I. DESCRIPTION OF THE ACCOMPLISHMENTS: 

A. Whet are/will be* the major projact/SIG accomp Wshroents as • result of this Information s*rv|a£7 
I. L , 3 — 



3. 



If Yes, please describe: 




B. Hoes your proJect/SIG still nave a need for technical assistance 

In this area7 (Please check) No _____ Y «» 



III. COMMENTS. 



A. Ware there some particularly strong and/or useful aspects 

of this Information service? (Please check) ™» "° 



If Yes, please describe: 



8. Ware there some weak or nonuseful aspects of this 

Information service? (Please check) Y# * No 



If Yes , please describe: 



45 DU 



SEE NEXT PAGE 5^ ^ 
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C. General Comments: Please list her* any addition*! comments that you wish to make regarding the 
Information service. 




r 1 

1 * 



Person completing form: 

(Name) 



(Staff Position) 



Return to TADS 

500 NCNB Plaza 
, Chape! Kill, N. C. 2751** 



THANK YOU. 



3 



V 



5x 



er|c. 




Project/SIG 



ID 

Process Fi naT 
Content A?iT 



TECHNICAL ASSISTANCE DEVELOPMENT SYSTEM 
Demonstration Pro|ect/SIG* Evaluation of Review/Critique 



rtich .r. Align*, to -onltor and •v.lu.t.^ ourworfc . W«r '«*•* » . ...lit.nca. It alto 

dential. 



Technical Assistance Haad No. 



Tachnlcal Assistance Objactlva No, 



rno^nl tant : 



nutfltf 



Imtruct lo 



PI..,, rat., ch.ctt. or ■■•« your r..pon... to th, quality %t th. tachnl eat-aa. UiwM 
— T-=T^->Lii«-in« iJmm w. would alio walcoma addltlona commantt regarding atpactt of.tha 
«SKltV5S«S f lS«r£ ?S"rS5l3 STravlaw/crltlq-a which -r. Important to yju 
and your proJect/SjG. » 

miAtm or w^tv.Evwtniouir. • • * s " , 



(Please circle your response) 



w O - 

iff U 
c « 



4 



A. Extent to which the revlew/cr 1 ! tlque 
net your staff's expectations. 

ft. The usefutness/epptlcablHty of the 
revlew/crltlque to your proJect/SIG. 

C. The quality 6f the overell review/ 
critique. 

D. Your overall satisfaction with the 
revlew/cr I tlqua. , 



\ff lirip lanantet Ion Grant 
TADS, UNf.-Chepal Hill, 1980 



OVEH 
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ii. /pes cm rr i oh of accomplishments. 



A. Vft>at_*/«/wl H ba tha major proJact/SIG aceonpl I shown t ft as a raftult of this rtvl tw/cr I tlquc? 
(P)J%% list) - , 



1. 









*' 2. 








5 


i 




J 




3. 






r 


B. Doe« your proJact/SIG III hava a naad for technical 
•ftftistancfl In this area? (PUata chack) 


NO 


Yat 


I If Yes. ftfaata daicrlba: 









Iff. COMMENTS. 



A. . Wara thara toma particularly strong and/or uftafjjl atpactft 

of tha ravlaw/crltlqua? (Plaata chack) Yai No 



If Yaft . pfaata datcribat 



6. Wara thara soma waak or nonusaful atpactft of tha 

raviaw/crltlqua? (Mtaia chack) . 1 No 



If Yaft . plaafta daicrlfcjat 



SEE NEXT fMt 
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C. Ganaral Cowwnti: Flaata Kit Kara any additional comntnti that you with to mika rtflardlng tha 
rav i tw/cr 1 1 1 qua . v , 



Marion conptatlng foraf: 



7B55T 



/staff Foil t ion) 



(latum to TAOS 

500 NCNI Plaza 

Ch«p«l Mill, H. C. 275»* 



THANK YOU. 



" APPENCIX---.fr'. 




TECHNICAL ASSISTANCE DEVELOPMENT SYSTEM 
nemnnstratlon Profect/SfG* Evaluation of Visitation 




PURPOSE.: We would appreciate information from you and your staff concerning the recent TADS-sponsored 
visitation which Is described below. This form includes a series of questions and ratings which are 
designed to monitor and evaluate ouY work. Your feedback will be combined with Information from other 
projects/SIGs to determine our current effectiveness and improve future visitations. It also will be 
shared with the site you visited. Your comments wi 1 1 otherwise remain confidential- 

We would appreciate your honest and objective opinions. THANK YOU VERY MUCH FOR YOUR TIME AND 

THOUGHTFULNESS. 



Technical -4£'si-stance Need no. 



Technical Assistance Object I ve No. 



Visitation Site: 



Oates: 



Instructions : Please rate, check, or list your responses regarding the visitation on the following items. 
For those items regarding the visitation site that were not applicable to your visit, please circle HA. 
Me would also welcome additional comments regarding aspects of the visitation or TAOS' procedures In 
arranging the visitation that were important to you and your project/SIG. '< 



QUALITY OF THE VISITATION. 

A. The Visitation Si te 

(Please ci rcle your' response) 

1. Evidence of pre-planning for 
your visit at the site.' 

2. Appropriateness of .act i vi ties scheduled. 

3. Access to appropriate staff. 

k. Opportunity for observation. 

v . ■ 

5. Opportunity for review of written 
materials. 



( « 
cl2 



NA 

NA 
NA 



. 1 

in >» 
♦J 0 



at 1 
% <o 

O 1-: 
— CI 

03 < 



8 



11 *J 
u c 

X CI 



Q-Ht 
CI c 



6. Quality of training in a practice NA 
or procedure. >' J 

7. Would you recommend this visitation 
site to other projects/SIGs with needs 
similar to yours? (Please check) No 



, Yes, with reservations 



Yes 



If Ho oja&es. with reservations, please explain: 



*State Imp I erne nt at fort Grant 
TAPS, UHC-Chapel Hill, I960 
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Sat i sf act ion wi th the V 1 s I ft 1 on 
(Please circle your response) "". 

K Extent to which the visitation ' 
met your expectations. 9 

2. The usefulness/applicability of 
the visitation to your project/ 
SI6 V . 

3. The quality of the visitation. 

4. Your overall satisfaction with 
the visitation. , 



♦J o 

m o 
c <t 



DESCftlPTIOM OF THE VI SI TAT I OH ACCOMPLISHMENTS. ' ' ' / 

A. What were the major accompl Ishments of the visitation? (Please list) 




31 

CO < 



I 



o c 
X 4) 



<u e 

x° 



l. 



2. 



3. 



B. Does your project/SIG still have a need for technical 

assistance In this area? (Please check) No , Yes 



If Yes » please describe,: 



SEE NEXT PAGE 
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III. COMMENTS. 



A. Were there some particularly strong and/or useful 

aspects of this visitation? (Please check) ' Yes No 

If yes, please describe: • 



Were there some weak or nonuseful aspects of 
this visitation? (Please check) 



Yes 



No 



If Yes, please describe: 



C. General rowments: Please list here any additional commeots tUt yon wish to make regarding the 
visitation. 



Person completing form: 

(Name) 

-J , 
~ (Staff/osltlonJ 



Return to TAOS 

500 NCNB Plaza , 

Chapel. Hill, N. C. 2751*1 

THANK YOU. 




APPENDIX- B 



PR0JECT/SI6 



TECHNICAL ASSISTANCE DEVELOPMENT SYSTEM 



Project/SIG 



10 

Process Final 
Content Area " 



Demonstration, Project/SIG* Evaluation of Conference/Workshop Presentation 



PURPOSE: We would appreciate information from you and yoV staff concerning the recent TAOS-sponsored 
presentation which is described below. This form includes a series of questions and ratings which are 
designed to monitor and evaluate our work. Your feedback wi 1 1 be combined with Information from other 
projects and SlGs to determine* our current effectiveness and improve future presentations. It a so 
♦will be shared with the presentor who worked with you. Your comments will otherwise remain confidential. 

We would appreciate your honest* and objective opinions. THANK YOU VERY MUCH FOR YOUR TIME ANO THOUGHTFULNESS . 



Technical Assistance Need No. 



Technical Assistance Objective No. 



Presentor: 



Oates: 



Instructions: Please rate, check or list your responses regarding the presentation on the following items. 
We would also welcome additional comments reoardlmj aspects of the presentation or TAOS' procedures In 
arranqlnq it which were Important to you and your project/Sir.. , . 

1. DUALITY OF THE PRESENTATION: 



A. The Presentor 

(Please circle your response) 

1. Preparedness , i.e., familiarity with your 
technical assistance need, Availability of 
appropriate materials, media, etc., evi- 
dence of organization and planning of 

the presentation, etc.* 

2. Con tent -area Expertise , I.e., knowledge 
of his/her content area, the material 
presented, etc. 

3. Presentation Skill and &yle , i.e., 
presentation of topic in a clear and 

, interest Ino way, maintenance of audience 
contact and involvement, flexibility, etc. 



k. Would you recommend the presen 
! with' you to other project 

similar to yours? (PJease check) 



resentoY who wo 
s/SIGs/tfith a n 



worked 
eed 



If No or Yes, with reservations , please explain: 



— u 
v > 

CO < 



8 



No Yes, with reservations Yes_ 



1 <— 
a to 

S 8 

X — 



6 ' 
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Satisfaction with Presentation : v 
(Please circle your response) 

1. Extent to which the presentation 
met your staff's expectations 

2. The usefulness/applicability of 
the presentation to the audience 

3. The quality of the overall 
presentation 

k. Your overall satisfaction with 
the presentation 



w O 

m «-» 

<ft u 

e m 



I 

I \ 

I 

I 



IS 

o > 

CO < 



u c 

X 4> 



a hi 

*> £ 
u o 
x — 
in *» 



II. DESCRIPTION OF THE PRESENTATION ACCOHPL I ShWENTS: 

A. What were the major accomplishments of the presentation? (Please list) 



I. 



2. 



6. Does your project/SIG still have a need for technical 
assistance in this area? (Please check) 



No 



Yes 



if Yes, please describe: 



SEE NEXT PAGE 
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III.- COHKENTSf 



fc A. Were there some particularly strong ami/or useful 
\ aspects of this presentation? (Please check) 



If Yes, please describe: 



Yes No 



fi. Were there some weak or nonuseful aspects of 
this presentation?' (Please check) , 



If Yes, please describe: 



Yes Mo 



C. General Comments: Please list here any additional cociments that you wish tq make regarding the, 
presentation. 



'Person completing form: 

(Name) 



(Staff Position) 



Return to: TADS 

500 NCNB Plaza 

Chapel HIM, NC 2751** 



THANK YOU. 



ERIC ss 6 ^ * > 
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TECHNICAL ASSISTANCE DEVELOPMENT SYSTEM 



Project/SIG 



Ift _ ~ 

Process FlnaT 
Content Area 



Donjons t rat Ion Project/SIG* Evaluation of Small Group Tachnlcal Ass I stance (TA) 



PURPOSE: We would appreciate Information from you and your staff concerning the recent TADS -sponsored 
small group meeting which Is described below. This form Includes a series of questions and ratings 
which are designed to monitor and evaluate our work. Your feedback will be combined with Information from 
other projects and SIGs to determine our current effectiveness and Improve future small group TA. 
Your comments will otherwise remain confidential. 



We would appreciate your honest and objective opinions. THANK YOU VERY MUCH FOR YOUR TIME AND THOUGMTFULNESS. 



Technical Assistance Need No. 



Technical Assistance Objective No. 



Topjc : 



Dates: 



Instruct ions ; Please rate, /check or list your responses regarding the small group TA on the foltowlnq 
Items. We would also welcome additional comments regarding aspects of the meeting' or TADS 1 procedures In 
arranging the meeting which Were important to you and your project/SIG. > 



I. QUALITY OF THE SMALL CROUP TECHNICAL ASSISTANCE. 



The Smell Group Technical Assistance 
(Please circle y6ur responiej 



H. L. 

*- o 

« *■» 

* o 

c iff 



- _ o 5 

AM &Z 



I. Group presentations and/or discussions 

^. Work for a specific time with an 

• individual consultant (I f appl I cable) 

3. Sharlno of ideas, concerns, etc., 
with other projact/SUJ personnel 

e. Organ! eat I on of meeting 

5. Materials/handouts 

6. Location/facilities 



*Stata Implementation Grant 
TADS, UNC-Chapel Hill, I9?D 



6\ 
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Satisfaction with thg Small Group 

Technical Assistance : 

( (PI aasa c ire It your rasponsa ) 

1. Extant to which tha matting mat 
your •xptctttlons 

2. Tha usafulnass/appl Icabl llty of 
tha masting to you and your 
projtct/SIG 

3. Tha quality of tha ovarall rotating 

k. Your ovarall satisfaction with 
tha malting 



~ o 

n 



■0 
8? 



o 
o> 
ft 

4m 

s 

< 



k 
k 




II. DESCRIPTION OF THE SHALL GROUP TECHNICAL ASSISTANCE ACCOMPLISHMENTS. 

A. What wara .tha major accompl i shmants of tha small group TA? (Plaasa list) 



1. 



2. 



3. 



Dots your proJact/SIG still hava a naad for tachnlcal 
assijtanca in this araa? (Plaasa chtck) 



If Vts , plaasa dascrlba: 



No 



Yas 

i 




SEE NEXT PAGE 
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II. COMMENTS. 



A. Were thare torn* particularly strong and/or useful 

aspects of this tnall group TAT (PI mm dftsck) "» _ No 





f . 


If Yas. pUasi describe: *r | 





Were there torn* weak or nonusa'ful aspects of this 
small group TA? (Pitas* chack) 

If Yes , please describe: ^_ 



Yes No 



C General Comnents: Plaase list hara any additional comments that you wish, to make regarding the 
meeting, A .a,, organization, procedures, topics covered, consultants, otc. 



Parscfn completing form: 



(Name J 



RtaT? Position) 



Return, to Meeting Convener 
OA 

* TAD* 
500 NCNB Plaza 
Chapel ill II, N. C. 27514 



THANK YOU. 



do 
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TADS 
End of Year Survey 



PURPOSE: 



> , 13 



USE: 



CONFIDENTIALITY: 



INSTRUCTIONS: 




The TAOS End of V#«r Survy is desighed to determine the 
overall effectiveness of the technical assistance delivered to 
HCEEP Demonstration Projects and State Implementation 
Grantees (SIQs) during a calendar year To accomplish this, 
the survey Is structured to gather information in three areas: 

1. The effects of TADS' assistance on the 
technical assistance needs which were identified for 
each program during the year; 

2. The impacts of TADS' technical assistance on' each 
program; and 

. 3. The program staff's satif faction with the technical 
assistance received from TADS. 

The results of the survey will be analyzed with other 
information provided during the year to determine the 
overall effectiveness of TADS. The information will be 
used to Improve TADS' services and report on its 
effectiveness to those audiences which are interested and 
invested in the result*. 

As is TADS' standard policy, the responses to this survey 
will be kept strictly confidential and reported only in 
grouped or anonymous individual formats. Your most 
objective and candid assessments of the assistance that 
TADS has provided to your program will be appreciated. 

Instructions for completing the survey are given at the 
beginning of each of the three sections. 



THANK YOU FOR YOUR COOPERATION. 

Technical Assistance Development System 
500 NCNB Plaza / 
Chapel Hill, North Carolina 27514 
June 1081 
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Technical Assistance Development System 
END OF YEAR SURVEY 

ID No 

L TECHNICAL AMISTANCI NEEDS AND SERVICES PROVIDED. Listed below art ■ series of quMtiont 
concerning the technical assistance need* which were Identified with your project/SIG* and which aracontalnad 
In your mamorandum of agraamant with TADS. Before aach aat of quaatlona la a atatamant of the technical 
aaalatance need, a brief description of the services which were acheduled tq meet the need, end the detea of the 
services. Please review thia Information carefully before enawerlng the quaatlona which follow. 

NEED No. . kfentJfM TA NMd TVpt of S«rvlc«/Provldtr Dutet 



1 . Did the aeope and/or direction of the task described In thia need change during the yeer? (please check) 
(1) —YES (2) —NO - V 
If YES, please restate the need aa it was changed: ASSISTANC5ETN _ _ 



9 

ERJC 



2. What waa the status of the task deacrlbed In the originally atated or, if changed, reatated needet the beginning of 
the year? (please check) 

(1) HAD NOT YET BEGUN TO PLAN WORK ON THIS TASK 

(2) HAD CONCEPTUALIZED AND/OR PLANNED THE WORK TO BE DONE 

(3) HAD BEGUN TO IMPLEMENT SOMEOF THE ACTIVITIES 

(4) HAD IMPLEMENTED MOST OF THE ACTIVITIES 

(6) HAD COMPLETED DESIRED WORK ON THIS TASK 

3. What la the status of the task described In the need now? (plesse check) 

(1 ) HAVE NOT YET BEGUN TO PLAN WORK ON THIS TASK 

(2) — HAVE CONCEPTUALIZED AND/OR PLANNED THE WORK TO BE DONE , 

(3) —HAVE BEGUN TO IMPLEMENT SOME OF THE ACTIVITIES 

(4) __HAVE IMPLEMENTED MOST OF THE ACTIVITIES 

(5) —HAVE COMPLETED DESIRED WORK ON THIS TASK 

Did you receive outside aasistance (other then from persons or resource* within the project/SIG) In this area from 
any person or source OTHER THAN TADS during the year (pleese check) 

(1) YES (2) NO 

If YES: 

a. From whom did you receive the assistance? (please check) (1) AN INDIVIDUAL CONSULTANT 

(2) AN AGENCY 



4. 



(3) OTHER: (Specify). 



b. How much assistance did you receive? (please check) (1 ) LESS THAN WAS PROVIDED BY TADS 

(2) APPROXIMATELY THE SAME AMOUNT 

AS PROVIDED BY TADS 

(3) MORE THAN WAS PROVIDED BY TADS 

5. What, in your opinion, did TADS contribute to your progress In this sree? (please check) 

(1) NOTHING 

(2) SOME 

(3) —A GREAT DEAL 

•Stale Implementation Grant ' OVER j**^— > 

Technical Assistance Development System, UNC-CH. 1981 ^W— - 
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It. IMPACTS OF TAPS' TECHNICAL ASSISTANCE. Ustad balow art both organizational and programmatic Impacti 
of TADS' technical asslstanca which hava bat n g I van to ua by projacta In tha past Praaaa ravlaw tha itams briaf ly to 
Idantify thair dlffarancaa and than datfrmlna If aach Impact occurrad In your projact AS A RESULT OF THE 
TECHNICAL ASSISTANCE YOU RECEIVED FROM TADS THIS YEAR. 

Aa you datarmlna your raaponaa plaaaa conaldar ALL of tha tachnlcal asslstanca you racalvad, a.g. a naads 
aaaftsmtnt confarancaa, consultations, Information aarvicaa. publications, ate., and not Just thosa aarvlcaa statad on 
tha pravloua pagaa. If otharJmpact s occurrad In your projact which ara not listsd. plaasa list tjwfon In tha spacas undar 
tha word "Othar." Than rata all of tha Impacts by circling your raaponsa. 

Offntnttoml Im^tf of TADS' Uchnkal AaaJstSfwa; T/»asa ara /mpacfa which occurred in m owll 
orgiMzttlon+nd operation of a prp/acf at a mutt of fchntctl ass/sfanca wind from TADS. 



A. Administration 



g S § b s b 

AlU Mil lilt 

Isis!s ill SlSs 

1. o^sk>n-makIng,a.g.,dacWlngcoursaa of action, salactlng 
spacmcmatarlaiaapproachaa.atc. -3 -2 -V 0 *1 *2 *3 

2. FoHcy changas, a.g., changaa In programmatic and/or 
administrate policy, ate. 

3. Program analysla, a.g.. Idarrtlflcatlon of program's strangths 
and waaknaaaaa. aattlng prTbrttiaa for afforta. ate. 

4. LaadaraNp styla, a.g.. approach of projact laadarshlp to 
admlnlatarlng projact. intaractlng with staff, ate. 

6. Commtml^ton^g.. communication qtylas and pattarns 
batwaan ahcrimong projact laadarshlp and staff, fiscal 
agancy administration and projact. ate. 

Othar » 



ft. Staff 

1. Staff rolaa, a.g., Idantlflcatlon and/or clarification of staff 
rolaa. rasponslbllltlas. ate. 

2. Staff Imowladgaand/primranaaa, a.g. ( naw knowladga. 
teaming, undaratandlng. atc> ^ 

3. Staff akMa, a.g., naw staff sklll^cHnpatanclfa. abllltlaa to 
admlnlatar and oparata tha program, ate. 

4. Staff attituda/Morala, a.g.. staff atUtuda. molrala. anthu- 
alasm. confldanca. ate. 

5. Staff undaratandlng of tha projact aa a modal NCEEP 
program, a.g.. undaratandlng of modal davaloprriaht, rolas 
In damonstratlon and dlssamlnatlon. ate. 

Othar 



-3-2-10 *1 *2 *3 

-3 -2 -1 0 *1 *2 *3 

-3 ' -2 -1 0 *1 *2 *3 

-3-2-10 *1 *2 *3 

-3 -2 -1 0 *1 *2 *3 

-3-2-10 *1 , *2 *3 

-3 -2 -1 0 *1 *2 f3 

-3-2-10 *1 *2 *3 

-3-2-10 *1 *2 *3 

-3 -2 -1 0 *1 *2 *3 

.3 m 2 -1 0 *1 *2 *3 



Tachnlcal Aaalstanca Davalopmant Systam. UNC-CH. 1881 Sm Ntxt Psgi 



3. 



APPENDIX C 



i Clarification. 

•organisation end cl^lllcatton^ 
t program efforts, appropriate component! of program 
pught together, tasks to I bo accomplished Idontlfiad 
/or clarified, ate. 

/clarification of goals and objectives, c.g 

/objective defintyfiOHecf action, ate* 

_ _ ) r ef inem en t, a.g., refinement of apociflc areaa such 
aa curricula, evaluation piabs. teaching approaches, intern 
agency linkages, etc. 




fc 6 S 



So So 
as *»a 



Program Oi 

1. Restart* MafltMoaUon, |e.g.. Identification of additional 
matetiatl. consultants, rcfourcee. etc. 

2. PfannlnfL e.g.. developing nt of plans for meetings, program 
components, eta 

3. Program i aiptamentattefi, e.g.. development establlahmant 
and/or operation of apacific components, actlvitlea. etc. 

1 4. Project ddpumeiHatlon/^ 

tlon and/or refinement of record-keeping, documentation 
ays tarns. < 

Product development, e.g.. development of materiala. 

curricula, tjfochures. *tc. 

Other 



-2 -1 0 *1 *2 >3 



-2-10, ♦! *2 *3 



-2 -1 0 *1 *2 *3 



-3-2-10 *1 *2 *3 



I* Program Sup 

ll Administratis support, e.g., aupport received for admln- 
letratlon of drogram, budgeting, etc, from fiscal agencies, 
other comm ^ntty, atate and/or federal agenclee. etc. 

Program reo ifnWon, e.g.. vleiblltty, credibility, etc.. for the 
program* etc 

3.| AMWanal finding, e.g., added funding for the program 
eeourad. etc 

Other 



I ^Development Syatem. UNC-CH, 1981 

• 2 



-3 -2 -1 0 *1 *2 *3 

-3 -2-10 ♦! *2 *3 

-3-2-10 *1 *2 *3 

-3-2-10 *2 *3 
OVER 
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P. Banattta to Non-Staff Parsons In tha Program 

1. tanaftts to ohMrwnt.g.. growth hi targat araaa. Ineraasad 
,, aarvicaa, ate. 

2. tanaftta to parants, a.g., akllla In taaehlng/parantlng, 
participation, ate. 

3. ttmftts lo othar participants (ooHtga atudants, adminis- 
trators, consultants, whinlaars,a^^^ 

undarstanding of tha program, tic. 



Othar 



Raiationa with Othar ExtarnaJ to Program 

1. Intaragancy ratations, a.g.. Improvad and/or Incraaiad 
raiationa with othar aganctaa. ate. 

2. Assistance to othar programs, a.g.. dlraot assistance 
provWad to othar programs, ate. 

3. Information sharing, a.g., sharing of ..information! with 
support parsonnal, admlnlstratlva aganclaa, othar agancy 
parson nai, ate. 

Othar 




Sissis s 3s nils 



tf 3 -2 -1 0 *1 *2 *3 

-3- -2 -1 0 *1 *2 *3 

-3 "-2 -1 0 *1 *2 *3 

-3-2-10 *1 *2 

-3 -2 -t 0 *1 *2 *3 

-3 -2 -1 0 *1 *2 *3 

-3-2-10 M *2 *3 

-3 -2 -10 *1 *2 *3 



Itehnkal Awtttanct D«vttopm«nt 8y»t«m. UNC-CH, 1861 
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Proffs/nmefte Impede of TADS' Technical Ass/sCance: 77?ese are impacts which occurred in specific areas o/ 
program operation as a result of technical assistance received from TADS. . 



§ §5 6 B § 

2 2 2 5 5 < 

£i tt s ? h l u i &| 



JL Service! for Children 




Sz Sz jz z ja 2 a 3> a 



1 . Identification and acquisition of children, e.g., determining 
who will be served, developing admission criteria, screening, 
referring children to other programs who are not admitted, 

etc. S f t -3 -2 -1 0 / +1 +2 +3 

2. Diagnosis and assessment, e.g.. Identifying and/or develop- 
ing instrumsnts, sstsblishing plans and/or procedures for 
diagnotis and/or assessment, diagnosing and/or assessing 

childre^etc. Y'V -3 -2 -1 Oy +1 +2 +3 

3. Instructl^iej program, e.g., designing IEP conferences, 
developing 1 EPs, curriculum development, designing spe- 
cific instructional strategies, developing on-going data 

keeping systerrt* to record progress of children, etc. j -3 -2 -7 0 +1+2 +3 

4. Services for children through other agencies, e.g., identi- 
fying agencies, establishing interagency coordination,' 

; acquiring services, placing children In other programs who 
leave the project, etc. -3-2-10 +1 +2 +3 

5. Determining the effectiveness of the services for children 
component, e.g., identifying and/or developing instruments, 

designing data gathering procedures, etc. -3 -2 -1 0 +1 +2 +3 

Other 



-1 0 +1 +2 +3 



+1 +2 +3 



— ? — — — i — : — r — " J ■ ' . . ' " 

Services for Parents ' v • •• ^ 1 

" ••>.-< ■ • • • ■< . • <• • ' . .-, •. . •' { . 

1. Introductory activities, e.g., orienting parents to project, 

assessing parent needs, etc. • , -2 -10 ■ +1 + 2. +3 

2. Involvement In project, e.g.. involving parents in IEP 
v conferences, .Involving parents In project operation, e.g., 

making material!, recruiting children, record keeping, etc. -3 
\ . <;< r- • J, • - * * 4 ", 

3. Direct services to parents, e.g.. training parents to tefcch 

their children, counseling parents, training parents In child 

development, etc. / ^ . > - , -3 -2 -1 0^ +1 +2 +3 

4. Services through other agencies; e.g.. identifying other 
agencies, establishing interagency agreements, assisting 

parents in receiving services from other agencies, etc. -3 -2 -1 0 +1 +2 +3 

5. Determining the effectiveness of the •ervteea for parent 
component, *g.. Identifying and/or developing instruments, 

designing data gathering procedures, etc. -3-2-10+1+2+3 
\ Other \ ', ' ' 



-2 -1 0 +1 +2 +3 



Technical Assistance Development System, UNC-CH, 19S1 OVER 



' APPENDIX C 



C* Staff Development 

1. Introductory activities, e.g., orienting staff to projact, 
identifying and/or developing instruments to datarmina 
staff davalopmant nfeds, idantifylng staff davaiopmant 
needs, ate. 

2. Conducting staff development, a.g., idantifylng resources 
for staff davalopmant, davaloplng staff davalopmant plans, 

conducting training, etc. „ . 

3. Determining the effectiveness of tha staff davaiopmant 
component, a.g. .identifying and/or davaloplng Instrument*, 
designing data gathering procaduras. ate. 

Other 



O. Oamonstration/Olssamination/Continuation 

1. Planning, a.g.. Idantifylng targats for demonstration, dis- 
semination and/or continuation, Identifying aspects of the 
project to be demonstrated or communicated, developing 
plans for demonstration, dissemination and/or continuation, 
etc. 




-3 -2,-1 0 *1 +2 +3 



♦1 +2 +3 



-2 -1 0 *1 +2 +3 



-3 -2-1 0 *1 +2 +3 
-3-2-10 +1 +2 +3 



2. Developing products, e.g., developing brochures, slide- 
tapes, films, reports, presentations, etc. 

3. Carrying out demonstration and/or dissemination activities, 

e.g., distributing materials, providing training, making f\, x • < ; I 

presentations. etc. t* . > *3 -2 -1 0 *:i +2 +3 , i**""'? 



4. Determining the effectiveness of the demonstration/dip- 
semination/continuation component, e.g.. identifying anch- 
or developing instruments, designing data gathering pro- 

- ceduree, etc. 

Otho* r 



♦1 +2 +3 



(f> -3 -2 -1 a ) +1 +2 +3 I \ 
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E. Administration/Management 

4 1. Pereotmol eelec ti on and tdmW iiw Bpn, e.g., developing 
Job descriptions for MCh staff position, developing policies 
tor staff hiring, promotion and termination, astablishing 
channels for staff communication, ate. v 

2. Urogram p lanning, a.g., davaloptng piahs for tha content 
and operation of tha program, ate. 



4. 



5. 



p e.g., reviewing and/or developing 
budgets, establishing procedures for financial administra- 
tion, designing and/or conducting a cost analysis, etc, 

Records end reports* e.g., designing record keeping 
systems, developing plans for producing reports, etc. 

Advisory board, e.g., determining role and function of 
advisory board, recruiting members of the advisory board, 
conducting advisory board meetings, etc. 

Coordination frith other agencies, e.g., Identifying other 
agencies, establishing cooperative agreements, fate. 

Other 




-1 



♦1 *2 +3 



-3-2-10 +1 +2 

-3 -2 -1 0 +1 +2 +3 

-3 -2 -1 0 +1 +2 *3 

-3-2-10 +1 +2 +3 



♦1 *2 +3 



i> M-g.. Identifying purposes for evaluation, identi- 
fying evaluation audiences and their information needs, 
Identity irio and/or clarifying aspects of the program to be 
evaluated, determining evaluation procedures, etc. 

2. Impleme n t ati on, e.g., Idsntitytngsr^/pr developing instru- 
ments, determining specific data analysis strategies, etp*» J 

3. Communication/Using reeutt*, e.g., developing formats, 
reports or other methods of communicating evaluation 
results, etc. 



-3 
-3 



-2 



0 
0 



-2 -1 0 



♦1 +2 +3 
♦1 +2 +3 

♦1 +2 +3 



\t +2 +3 ' 
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SATISFACTION WITH TAOS* TECHNICAL ASSISTANCE j= S < Q 3 a 

S Q fi -O * * 



co 3 3 2 O O 

A. Please indicate your satisfaction with this year's TADS' Z g 5 § S S 
technical assistance to your project by circling your 
response. 1 

B. Comments: Please list here any comments which you 
would like regarding the technical assistance you have 
received from TADS this year. ' 



THANK YOU 
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TADS 
End of Year Survey 



PURPOSE: 



USE 



CONFIDENTIALITY: 



INSTRUCTIONS: 




The TADS End of Year Survey is designed to determine the 
overall effectiveness of the technical assistance delivered to 
' HCEEP Demonstration Projects and State Implementation 
Grantees (SIGs) during a calendar year. To accomplish this, 
the survey ii structured to gather information in three areas: 

1. The effects of TADS' assistance on the 
technical assistance needs which were identified for 
each program during the year; 

2. The impacts of TADS' technical assistance on each 
program; and- 

&. The program staffs satisfaction with the technical 
assistance received from TADS. 

The results of the survey will be analyzed with other 
information provided during the year to determine the 
pverall effectiveness of TADS. The information will be 
used to Improve TADS' services and report on Its 
effectiveness to those audiences which are interested and 
Invested in the results. 

As is TADS' standard policy, the responses to this survey 
will be kept strictly confidential and reported only irt 
groupec) or anonymous individual formats. Your most 
objective and candid assessments of the assistance tha(t 
TADS has provided to your program will be appreciated. 

Instructions for completing the survey are given at thfe 
beginning of each of the three sections. 



YRAMYOV FOfi VOW COOPERATION. 

Technical Assistance Development System 
500 NCNB Plaza 
Chapel Hill, North Carolina 27514 
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Technical Assistance Dtvtlopmtnt System 
ENP OF YEAR SURVEY 

IDNo^ 



TECHNICAL ASSISTANCE NEEDS AND SERVICES PROVIDED. Listed below are a series of questions 
cqncerning*he technical assistance needs which were identified with your project/SIG* and which are contained 
in your memorandum of agreement with TADS. Before each set of questions is a statement of the technical 
assistance need, a brief ^description o( the services which were scheduled to meet the need, and the dates of the 
services. Please review this information carefully before answering. the questions which follow. 



NEED No. u Identified TA Need Type of Service/Provider Dates : 



1. Did the scope and/or direction of the task described in this need change during the year? (please check) 
(1) YES (2) NO 

If YES, please restate the need as it was changed: ASSISTANCE IN . 



2. What was the status of the task described in the originally stated or. If changed, restated need at the beginning of 
the year? (please check) 

(1 ) iHAD NOT YET BEGUN TO PLAN WORK ON THIS TASK 

(2) HAD CONCEPTUALIZED AND/OR PLANNED THE WORK TO BE DONE 

(3) HAD BEGUN TO IMPLEMENT SOME OF THE ACTIVITIES 

(4) HAD IMPLEMENTED MOST OF THE ACTIVITIES ✓ 

(5) HAD COMPLETED DESIRED WORK ON THIS TASK 

3. What is the status of the task described in the need now?, (please check) 

(1) HAVE NOT YET BEGUN TO PLAN WORK ON THIS TASK 

(2) HAVE CONCEPTUALIZED AND/OR PLANNED THE WORK TO BE DONE 

(3) HAVE BEGUN TO IMPLEMENT SOME OF THE ACTIVITIES 

(4) _HAVE IMPLEMENTED MOST OF THE ACTIVITIES 

(5) HAVE COMPLETED DESIRED WORK ON THIS TASK 

Did you receive outside assistance (other than from persons or resources within the project/SIG) in this area from 
any person or source OTHER THAN TADS during the year (please check) 

(1) YES * (2) NO 

If YES: 

a. From whom did you receive the assistance? (please check) (1 ) AN INDIVIDUAL CONSULTANT 

(2) * AN AGENCY 

i (3) OTHER: (Specify) : 

b. How much assistance did you receive? (please check) (1 ) LESS THAN WAS PROVIDED BY TADS 

(2) APPROXIMATELY THE SAME AMOUNT 

AS PROVIDED BY TADS* 

(3) MORE THAN WAS PROVIDED BY TADS 

5. What, in your opinion, did TADS contribute to your progress in this area? (please check) 

(1) NOTHING 

(2) SOME 

(3) A GREAT DEAL 

'State Implementation Grant OVER S^-^CJ 

Technical AA^stsnce Development System, UNC-CH, 1081 <w— ^ 
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It IMPACTS OF TADS' TECHNICAL ASSISTANCE. Please list below t'ny impacts, either positive or negative, which 
you believe have occurred with your 8IG AS A RESULT OF THE TECHNICAL ASSISTANCE YOU RECEIVED 
PROM TADS THIS YEAR. 

As you will notice, the space provided for comments is divfded injo three different levels et which impacts of 
technical assistance may occur (a) The SIG program end staff; (b) The State Education Agency; and (c) Other 
individuals, aj^ncies or groups. Please select the appropriate level or levels and describerwhtft you believe the 
impact of technical assistance to hi v e ■ b ee r uBsiporint may include, but are nor resfr/cfed to, areas suph as;the 
1 following: . . , " -77 \ j 

• administration interagency agreements 

• communication , • evaluation > 

• staff roles, skills, responsibilities • statewide planning 

• SIG program clarification or operation • policy development , 

• program standards and guidelines • in-service training 

As you determine your response, please consider ALL of the technical-assistance you received, e.g.. npeds 
assessment, conferences, consultations, information services, publications, etc., and not just those services 
associated with the technical assistance needs listed on the previous pages. 

STATEMENTS ABOUT THE IMPACTS OF TADS' TECHNICAL ASSISTANCE 

POSITIVE IMPACTS NEGATIVE IMPACTS \ 

On tha SIG Program and Staff: 

1 , ■ 1 : ': — — 



2 . - 2. X- 



3. 



On tha Stata Education Agsrtcy: 

1. 



2. 



? 1 . : 

,i i ' {l ',. . it 

On Othsr Individuals, Agencies or*Groups: * *<- 

1 : ; — ^ 1. ■ ; - 
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III. SATISFACTION WITH TADS' TECHNICAL ASSISTANCE | W 5 g x x 

A. Picas* indicate your satiafaction with TADS' technical 1 2 3 4 5 6 
assistance to your SIQ by circling your response. 

S.. v Comments: PleaseJIat here any comments which you would Ilka regarding the technical assistance 
'oTyou havi received Vom TADS thia year ; 



THANK YOU 
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